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Preface 
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Exercise  project.  The  first  assignment.  Interaction  on  emotion,  will  be  discussed 
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Arno  Hartholt  and  Tijmen  Muller 
January  16,  2004 


^Working  and  lunching,  for  example,  was  made  more  enjoyable  because  of  Charlie,  who 
wouldn’t  leave  our  side.  We  tried  to  reason  with  him.  We  tried  to  convince  him  he  was 
beginning  to  annoy  us.  He  still  wouldn’t  leave  our  side. 
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Abstract 


This  report  describes  the  addition  of  an  emotion  dialogue  to  the  Mission  Re¬ 
hearsal  Exercise  (MRE)  system.  The  goal  of  the  MRE  system  is  to  provide  an 
immersive  learning  environment  for  army  officer  recruits.  The  user  can  engage 
in  conversation  with  several  intelligent  agents  in  order  to  accomplish  the  goals 
within  a  certain  scenario.  Although  these  agents  did  already  posses  emotions, 
they  were  unable  to  express  them  verbally.  A  question  -  answer  dialogue  has 
been  implemented  to  this  purpose.  The  implementation  makes  use  of  propo¬ 
sition  states  for  modelling  knowledge,  keyword  scanning  for  natural  language 
understanding  and  templates  for  natural  language  generation.  The  system  is 
implemented  using  Soar  and  TCL. 

An  agent  can  understand  emotion  related  questions  in  four  different  domains, 
type,  intensity,  state,  and  the  combination  of  responsible- agent  and  blamewor¬ 
thiness.  Some  limitations  arise  due  to  the  techniques  used  and  to  the  relative 
short  time  frame  in  which  the  assignment  was  to  be  executed.  Main  issues  are 
that  the  existing  natural  language  understanding  and  generation  modules  could 
not  be  fully  used,  that  very  little  context  about  the  conversation  is  available 
and  that  the  emotion  states  simplify  the  emotional  state  of  an  agent.  These 
limitations  and  other  thoughts  give  rise  to  the  following  recommendations  for 
further  work: 

•  Make  full  use  of  references. 

•  Use  coping  strategies  for  generating  agent’s  utterances. 

•  Use  focus  mechanisms  for  generating  agent’s  utterances. 

•  Extend  known  utterances. 

•  Use  NLU  and  NLG  module. 

•  Use  emotion  dialogue  and  states  to  influence  emotions. 

•  Fix  known  bugs. 


Keywords:  natural  language,  dialogue,  emotions,  multi-agent  systems,  key¬ 
word  scanning,  templating 
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Chapter  1 

Introduction 


This  document  is  the  report  of  one  of  two  internship  assignments  -  the  assign¬ 
ment  is  explained  in  chapter  3.1.  This  chapter  gives  a  brief  introduction  to 
the  Mission  Rehearsel  Exercise  and  the  current  implemented  scenario.  A  more 
extensive  explanation  of  the  system  will  be  given  in  chapter  2.  Chapter  3  gives 
the  requirements  of  our  assignment.  In  chapter  4,  we  analyse  the  parts  of  the 
system  that  are  important  to  our  assignment  and  mention  the  datastructures 
we  need  to  use  or  design.  The  design  and  implementation  are  given  in  respec¬ 
tively  chapter  5  and  chapter  6.  The  testing  phase  will  be  discussed  in  chapter  7. 
The  conclusion  and  recommendations  can  be  found  in  chapters  8  and  9.  The 
appendices  contain  the  possible  speech  acts,  written  code  and  test  plans. 


Figure  1.1:  Screenshot  of  the  Bosnia  scenario 


1.1  Mission  Rehearsel  Exercise  project 

The  goal  of  the  Mission  Rehearsal  Exercise  system  is  to  provide  an  immer¬ 
sive  learning  environment  where  the  participants  experience  the  sights,  sounds 
and  circumstances  they  will  encounter  in  real-world  scenarios  while  performing 
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CHAPTER  1.  INTRODUCTION 


mission-oriented  training  [ICT03].  The  user  can  engage  in  conversation  with 
several  intelligent  agents  in  order  to  accomplish  the  goals  within  a  certain  sce¬ 
nario.  We  will  explain  more  about  the  system  in  chapter  2. 


1.2  Bosnia  scenario 

In  the  Bosnia  scenario  the  user  is  a  young  lieutenant  in  the  US  Army  on  his 
first  peacekeeping  mission.  As  you  are  sent  to  help  another  group  of  soldiers, 
called  Eagle  1-6,  inspect  a  suspected  weapon  cache  in  a  town  called  Celic,  you 
find  that  an  accident  occured  at  the  assembly  area:  a  civilian  car  crashed  into 
one  of  your  platoon  vehicles.  A  local  boy  lies  injured  on  the  ground,  with  his 
mother  and  a  medic  from  your  team  next  to  him.  In  the  background  a  group 
of  locals  is  gathering  and  unrest  is  rising.  A  sketch  of  the  situation  is  drawn  in 
figure  1.2. 


route  to  Celic 
landing  zone  _ .. 


assembly 

area 


12  to  4 


accident  site 


8  to  12Q  Q 


4  to  8 


Figure  1.2:  The  situation  in  the  Bosnia  scenario 

It  is  up  to  you  to  decide  what  your  team.  Eagle  2-6,  is  going  to  do.  You 
have  the  possibility  to  move  along  to  Celic  or  try  and  help  the  boy.  One  way  is 
to  call  an  ambulance,  another  is  to  call  the  emphMedEvac,  a  helicopter,  from 
your  base.  Either  way,  you  need  to  interact  with  your  teammembers  to  find  a 
solution. 

As  the  user  you  are  able  to  interact  with  three  emphintelligent  agents:  the 
sergeant,  the  medic  and  the  mother  of  the  injured  boy.  [Ric02] 


Chapter  2 

Background 


The  Mission  Rehearsal  Exercise  (MRE)  project  tries  to  create  an  immersive  and 
interactive  learning  environment  in  which  users  can  gain  experience  through 
decision-making  scenarios  [Ric02],  like  the  Bosnia  scenario  described  in  chap¬ 
ter  1.  An  important  part  of  making  such  an  environment  both  believable  and 
useful  is  the  use  of  intelligent  agents  that  cohabit  virtual  worlds  with  people, 
and  support  face-to-face  dialogue,  serving  as  guides,  mentors  and  teammates. 
In  the  Bosnia  scenario,  the  sergeant,  medic  and  mom  are  implemented  as  such 
agents. 

The  whole  system  tries  to  immerse  the  user  by  displaying  the  visuals  on  an 
eight-foot-tall  screen  in  a  150-degree  arc  with  a  12-foot  radius.  The  graphics 
are  rendered  with  Multigen-Paradigm’s  Vega.  Immersive  audio  software  uses  10 
audio  channels  and  two  subwoofer  channels  to  envelop  a  participant  in  spatial- 
ized  sounds  that  include  general  ambience  (such  as  crowd  noise)  and  triggered 
effects  (such  as  explosions  or  helicopter  flyovers). 

This  chapter  provides  the  reader  with  a  theoretical  and  practical  background 
concerning  the  MRE  technology.  In  section  2.1  we  talk  briefly  about  it’s  archi¬ 
tecture.  Next,  we  discuss  Steve,  the  result  of  former  research  by  the  University 
of  Southern  California’s  Information  Sciences  Institute,  which  forms  the  basis 
for  the  MRE  agents.  As  emotions  and  natural  language  are  of  particular  interest 
for  this  assignment,  these  are  discussed  separately  in  sections  2.3  and  section  2.4 
respectively. 


2.1  MRE  architecture 

MRE  seeks  to  integrate  and  expand  several  results  form  various  fields  of  re¬ 
search,  like  embodied  agents,  natural  language  and  emotion.  Figure  2.1  gives 
an  overview  of  it’s  architecture. 

The  MRE  system  consists  of  a  virtual  world  and  it’s  agent  inhabitants.  The 
world  is  modeled  by  a  set  of  sequence  files  wherein  states  and  state  changes  are 
defined.  These  files  can  be  called  both  by  the  system  and  the  system’s  oper¬ 
ator  using  a  GUI.  The  agents  use  speech  recognition  software  (Sonic)  and  an 
in-house  developed  Natural  Language  Understanding  module.  The  core  of  the 
agents  is  formed  by  Soar  code,  which  models  perception,  planning,  emotion, 
dialogue,  natural  language  generation  and  action.  Soar  is  a  low-level  reason- 
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planning-,  emotion-, 

and  dialogue  system  gesture  scheduler 


Figure  2.1:  Architecture  of  the  MRE  system 


ing  programming  language,  which  builds  an  environment  by  creating  very  small 
datablocks  by  the  name  of  working  memory  elements  (WME).  These  WME’s 
contain  very  small  pieces  of  information  about  the  world.  By  the  use  of  op¬ 
erators,  which  are  defined  by  the  programmer  himself,  it  is  possible  to  reason 
about  the  world  [Lai99].  The  Soar  code  makes  up  Steve,  wich  will  be  discussed 
in  more  detail  in  section  2.2. 


Steve’s  text  output  is  synthesized  into  speech  by  Festival.  This  module  works 
together  with  the  Beat  module  which  creates  gestures  to  accompany  the  speech. 
The  sound  and  visuals  of  both  the  world  and  the  agents  are  generated  through 
some  audio  protocols  and  DIMR.  DIMR  is  the  visualization  module,  consisting 
of  Vega  (renders  the  environment  and  special  effects),  PSERT  (People  Shop  TM 
Embedded  Runtime  System,  responsible  for  animating  the  agents)  and  Haptek 
(facial  animations).  All  the  modules  communicate  via  Elvin/XML  messages 
through  a  shared  communication  bus. 


2.2.  STEVE 
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2.2  Steve 

Steve  is  the  result  of  the  University  of  Southern  California’s  Information  Sciences 
Institute  research  and  is  capable  of  collaborating  with  people  in  3D  virtual 
worlds  as  an  instructor  or  teammate.  It  is  able  to  provide  feedback  to  students 
and  can  lead  students  around  in  the  virtual  world. 

Steve’s  cognitive  basis  is  formed  by  a  domain-independent  layer,  constructed 
in  Soar.  Soar  is  a  general  model  of  human  cognition  and  as  such  provides  Steve 
with  basic  cognitive  capabilities.  These  basics  are  enhanced  to  support  task- 
oriented  collaboration,  like  demonstration  and  conversation.  On  top  of  this 
layer,  a  declarative  representation  of  domain  tasks  can  be  placed.  For  a  more 
extensive  introduction  to  Steve,  see  [RicOO]. 

For  the  MRE  project,  Steve  had  to  be  extended  in  a  variety  of  ways.  We’ll 
shortly  discuss  perception,  virtual  bodies  and  task  planning  here,  emotions  and 
natural  language  are  described  in  the  following  sections. 

2.2.1  Perception 

In  order  to  make  an  agent  believable  as  a  virtual  human,  it  has  to  perceive  his 
environment  the  same  way  a  real  human  being  should.  Originally,  Steve  was 
omniscient;  he  received  messages  from  the  virtual  world  simulator  describing 
every  state-change  relevant  to  his  task  model,  regardless  of  his  current  location 
or  attention  state.  In  MRE,  the  Steve  agent’s  perception  is  more  human-like, 
following  the  research  presented  in  [Hil99],  [HilOO]  and  [Cho99].  His  vision  is 
limited  to  190  horizontal  degrees  and  90  vertical  degrees.  The  level  of  detail 
Steve  perceives  about  objects  is  high,  medium,  or  low,  depending  on  where  the 
object  is  in  his  field  of  view  and  whether  he  is  giving  attention  to  it.  Steve 
can  perceive  both  dynamic  and  static  objects  in  the  environment.  The  first  are 
perceived  under  the  control  of  a  simulator,  by  filtering  updates  that  the  system 
periodically  broadcasts.  Static  objects  such  as  buildings  or  trees  are  perceived 
by  using  the  scene  graph  and  edge-detection  and  are  encoded  in  a  cognitive 
map. 

2.2.2  Virtual  body 

Steve’s  is  a  so-called  emobied  conversational  agent,  which  is  a  type  of  virtual 
body  that,  next  to  speech,  uses  nonverbal  communication  like  facial  expressions, 
gestures  and  body  stance  when  engaging  in  conversation.  For  an  introduction 
to  embodied  conversational  agents,  see  [CasOO]. 

Steve  was  designed  to  accommodate  different  bodies.  His  motor-control 
module  accepts  abstract  motor  commands  from  his  cognition  module  and  sends 
detailed  commands  to  his  body  through  a  generic  APL  Steve’s  original  body, 
although  suitable  for  tutoring  ends,  had  some  limitations  which  restricted  it 
from  simulating  a  life-like  human  being.  It  had,  for  instance,  no  legs,  and  it’s 
gestures  and  facial  expressions  where  somewhat  limited.  For  MRE,  new  bodies 
were  developed  by  Boston  Dynamics  Incorporated  with  faces  developed  by  Hap- 
tek  Incorporated.  In  order  to  provide  the  agents  with  a  realistic  body  without 
losing  flexibility  over  their  motions,  a  method  using  both  motion  capture  and 
procedural  animation  was  used.  Motion  capture  provided  a  basic  repertoire  of 
gestures,  which  were  then  decomposed  into  stages  (such  as  preparation,  stroke, 
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and  retraction) .  Moreover,  these  gestures  are  available  in  two  extremes:  a  small, 
restrained  one  and  a  large,  emphatic  one.  A  Steve  agent  can  dynamically  gen¬ 
erate  any  gesture  between  these  extremes  by  specifying  a  weighted  combination 
of  the  two.  Thus,  bodies  leverage  the  realism  of  motion  capture  while  providing 
the  flexibility  of  procedural  animation. 

2.2.3  Task  planning 

In  a  system  with  agents  serving  as  teammates,  an  agent  should  be  able  to  do 
some  goal  focused  planning:  task  modelling.  For  a  believable  world,  the  user 
should  be  able  to  act  freely,  within  the  restrictions  of  the  scenario,  e.g.  taking 
the  goals  of  the  scenario  into  account.  This  means  the  user  has  to  be  free 
in  decision  making,  trying  different  alternatives,  and  interact  naturally  with 
teammates.  As  a  result,  the  agents  need  to  be  able  to  understand  authority, 
responsibility,  coordinated  actions,  organizational  relationships  and  most  of  all 
the  structure  of  tasks. 

The  plan  representation,  which  is  a  relatively  standard  hierarchical  model, 
consists  of  a  set  of  steps,  either  primitive  (i.e.  a  physical  or  sensing  action)  or  ab¬ 
stract  (i.e.  a  task  that  needs  further  decomposing),  a  set  of  ordering  constraints, 
and  a  set  of  causal  links  and  threat  relationships  that  define  the  dependencies 
among  the  steps.  In  this  way,  a  causal  link  can  define  one  step  as  either  a 
precondition  or  a  threat  to  another  step.  In  the  MRE  project,  the  agents  use 
domain-independent  reasoning  algorithms  over  general  representation  of  team 
tasks  to  create  a  task  model.  In  order  to  create  such  a  model,  the  agent  uses 
the  implemented  tasks  and  world  knowledge. 

In  addition  to  the  understanding  of  the  tasks,  the  agents  also  need  to  un¬ 
derstand  the  social  relationships  or  roles  among  themselves.  One  thing  is  that 
the  task  steps  are  linked  to  an  agent  responsible  for  that  task.  Another  is  the 
optional  authorizing  agent  -  a  responsible  agent  cannot  execute  his  task  before 
the  authorizing  agent  has  granted  his  authority;  this  is,  of  course,  very  common 
in  the  military. 

Given  an  abstract  task  for  the  whole  team  to  accomplish,  each  agent  inde¬ 
pendently  uses  his  task  knowledge  to  create  his  task  model.  This  practically 
means  decomposing  the  abstract  task  recursively  until  a  task  model  has  been 
created.  Since  agents  may  not  have  the  same  knowledge,  different  task  mod¬ 
els  may  occur  for  different  agents.  As  a  result,  negotiating  may  be  needed  - 
here,  natural  language  comes  into  focus,  with  the  different  roles  in  the  back¬ 
ground  [Tra03]  [Ric02]. 


2.3  Emotions 

One  of  the  main  goals  of  the  MRE  project  is  implementing  a  computational 
model  of  human  behavior.  Emotions  are  considered  a  very  important  part  of 
artificial  intelligence,  since  they  have  a  great  influence  on  human  behavior,  are 
needed  to  correctly  interpret  beliefs,  motives  and  intentions,  and  play  an  impor¬ 
tant  role  in  social  communication.  Of  course,  emotions  are  tightly  connected  to 
other  capabilites  of  these  virtual  humans,  such  as  planning,  acting,  natural  lan¬ 
guage  understanding,  and  speech.  Creating  a  domain-independent  model  could 
assist  in  building  believable  intelligent  agents  in  general.  [Gra04]. 
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2.3.1  Theoretical  framework 

Attempting  to  find  an  unified  theory,  the  MRE  project  characterizes  emotion  as 
the  result  of  cognitive  appraisal.  Cognitive  appraisal  emphasizes  the  connections 
between  cognition,  emotion,  personality  and  the  resulting  coping  strategies, 
following  certain  psychological  theories. 

Strategy  Description 

active  coping  taking  steps  to  remove  or  circumvent  the  stressor 

planning  coming  up  with  action  strategies 

seeking  social  support  seeking  advice,  assistance,  or  information 


Table  2.1:  Problem- focused  coping  strategies 


The  sources  for  all  emotional  behavior  are  the  environment  and  the  goals 
and  beliefs  of  an  agent.  Appraisal  can  be  seen  as  the  interpretation  of  the 
person-environment  relationship,  assigning  values  to  abstract  attributes  of  this 
relationship,  called  appraisal  variables  -  these  are  listed  in  table  4.1.  The  envi¬ 
ronment  partly  consists  of  other  agents;  this  is  represented  by  the  fact  that  an 
agent  may  have  beliefs  about  the  feelings  of  other  agents.  The  appraisal  vari¬ 
ables’  values  depend  on  the  cognitive  processes  that  build  up  the  individual’s 
interpretation  of  how  (external)  events  influence  their  goals  and  beliefs. 

The  resulting  coping  strategies  plan  actions  to  change  either  the  environment 
{problem-focused  strategies)  or  the  agent’s  goals  and  beliefs  {emotion- focused 
strategies).  Some  common  coping  strategies  are  listed  in  table  2.1  and  table  2.2. 
What  strategy  is  picked  by  an  agent  is  based  on  his  ‘personality’:  for  example, 
a  self-confident  agent  would  use  a  planning  strategy  to  solve  a  problem,  while 
a  not  so  confident  agent  could  use  a  denial  strategy.  The  system  is  explained 
graphically  in  figure  2.2. 


Strategy 

suppress  competing  activities 

restraint  coping 

seeking  social  support 

positive  reintegration 

acceptance 

denial 

behavioral  disengagement 
mental  disengagement 


Description 

put  other  projects  aside  or  let  them  slide 
waiting  for  appropriate  opportunity,  holding  back 
getting  moral  support,  sympathy,  or  understanding 
look  for  silver  lining  and  try  to  grow  as  a  person 
accept  stressor  and  learn  to  live  with  it 
denying  the  reality  of  event 
admit  you  cannot  deal  and  reduce  effort 
daydreaming,  sleeping,  turn  to  drugs  or  religion 


Table  2.2:  Emotion- focused  coping  strategies 

The  following  is  a  simplified  algorithm  for  cognitive  appraisal  by  the  name 
of  the  EMA  algorithm.  It  is  explained  in  detail  in  [Gra04] . 

1.  Construct  and  maintain  a  causal  interpretation  of  ongoing  world  events  in 
terms  of  beliefs,  disires  and  intentions. 

2.  Generate  multiple  appraisal  frames  that  characterize  features  of  the  causal 
interpretation  in  terms  of  appraisal  variables. 

3.  Map  individual  appraisal  frames  into  individual  instances  of  emotion. 
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Figure  2.2:  The  cognitive-motivational-emotive  system 


4.  Aggregate  emotion  instances  into  a  current  emotional  state,  focusing  on 
instances  associated  with  recent  changes  to  the  causal  interpretation. 

5.  Adopt  a  coping  strategy  in  response  to  the  current  emotional  state. 

2.3.2  So,  what  is  actually  implemented? 

To  implement  a  realistic  emotional  behavior  in  an  interactive  setting,  the  coping 
strategies  need  to  be  dynamically  dependent  of  the  underlying  emotional  system. 
This  means  the  internal  processes  of  an  agent  in  the  MRE  system  need  to  lead 
to  facial  expressions,  gestures,  intonation  and  action  planning.  A  realisation 
needs  to  satisfy  various  requirements: 

•  To  make  dynamic  interaction  possible  on  cognition,  appraisal  and  cop¬ 
ing,  the  model  must  represent  intermediate  knowledge  states  that  can  be 
appraised. 

•  To  reason  about  relevance  and  desirability,  the  model  must  represent  pref¬ 
erences  over  outcomes. 


•  To  make  causal  attributions,  causal  relations  between  states  need  to  be 
possible. 
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•  To  reason  about  likelihood  and  expectedness  about  future  states,  the  sys¬ 
tem  needs  to  represent  factors  influencing  events,  outcomes  and  interaction 
between  these  events. 

•  To  reason  about  urgency,  the  system  needs  to  have  some  notice  of  time. 

•  To  reason  about  controllability,  the  system  must  represent  to  what  extent 
events  can  be  controlled. 

•  To  reason  about  social  power,  the  system  need  to  represent  relations  and 
organizational  hierarchies  of  agents. 

•  To  reason  about  adaptability  and  to  support  emotional  coping  strategies, 
the  system  must  represent  subjective  beliefs. 

•  To  reason  about  ego-involvement,  the  system  needs  to  represent  how  ‘ego¬ 
istic’  a  desire  of  an  agent  is. 

In  order  to  meet  these  requirements,  the  emotional  system  of  MRE  is  based 
on  the  design  of  Steve  (section  2.2,  which  in  turn  is  built  using  Soar.  This  makes 
it  possible  to,  for  example,  reason  about  a  certain  event  that  is  about  to  happen 
and  that  endangers  the  personal  desires  (or  desired  states)  and  as  a  result  leads 
to  appraised  fear.  More  details  about  the  way  the  emotional  state  of  an  agent 
is  constructed  in  the  MRE  system  is  presented  in  section  4.1. 

The  emotional  state  and  the  coping  strategies  together  result  in  mental  and 
physical  activity.  At  this  point,  these  states  are  linked  to  the  movement  of  the 
virtual  body,  so  the  agent  adjusts  his  facial  expressions  and  gestures  to  what 
he  feels.  Manipulation  of  the  utterances  (different  utterances  for  one  speech 
act  and  adjusted  intonation,  depending  on  emotion)  has  only  been  partially 
implemented,  but  the  foundation  to  realize  the  whole  of  it  is  present. 


2.4  Natural  language 

Steve  used  commercial  speech  recognition  and  synthesis  products  to  communi¬ 
cate  with  human  students  and  teammates.  It  had  no  true  natural  language  un¬ 
derstanding  capabilities  and  understood  only  a  relatively  small  set  of  preselected 
phrases.  Although  easy  to  implement,  this  method  has  two  major  drawbacks. 
The  obvious  one  is  that  a  system  with  hard  coded  language  is  very  limited  in 
both  understanding  and  generating  speech,  and  that  adding  new  content  is  a 
cumbersome  task.  Secondly,  all  the  recognition  is  done  by  the  speech  recognizer 
itself  rather  than  by  modules  that  have  access  to  the  evolving  task  and  dialogue 
context.  Because  of  these  reasons,  Steve  has  been  modified  in  a  variety  of  ways. 
We  distinguish  three  areas,  namely  dialogue,  natural  language  understanding 
(NLU)  and  natural  language  generation  (NLG).  These  will  be  discussed  in  the 
following  subsections. 

2.4.1  Dialogue 

In  MRE,  the  main  conversation  is  between  the  lieutenant  and  the  sergeant. 
Also,  the  medic  is  some  times  brought  in,  and  the  mother  is  an  important 
overhearer.  Additionally,  separate  conversations  between  the  sergeant  and  the 
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squad  leaders  occur,  and  both  the  lieutenant  and  the  sergeant  can  engage  in 
some  radio  conversation.  The  agents  must  be  capable  to  reason  about  who  they 
are  talking  to,  who  is  listening,  and  whether  they  are  being  addressed. 

The  dialogue  model  used  within  MRE  is  capable  of  accomplishing  these 
multi-party,  multi-conversation  dialogues.  It  is  modelled  as  a  layered  structure: 

•  contact 

•  attention 

•  conversation 

—  participants 

—  turn 

—  initiative 

—  grounding 

—  topic 

—  rhetorical 

•  social  commitments  (obligations) 

•  negotiation 

The  state  of  each  layer  is  represented  by  an  information  state  and  a  set  of 
dialogue  acts  corresponding  to  changes  to  this  information  state.  There  are  also 
conventional  signals  -  behaviors  (for  instance  a  speech  act  or  gazing)  that  can 
be  associated  with  the  performance  of  dialogue  acts,  given  the  right  context. 

The  contact  layer  is  concerned  with  which  individuals  are  accessible  for 
communication.  The  attention  layer  concerns  the  object  or  process  that  agents 
attend  to.  Contact  is  required  for  attention.  The  conversation  layer  models 
the  separate  dialogue  episodes  that  go  on  during  an  interaction.  This  layer  has 
several  sub-layers  which  may  consist  different  information  for  each  conversation 
that  is  going  on.  The  participants  include  active  speakers,  adressees,  or  over¬ 
hearers.  The  turn  indicates  which  participant  has  the  right  to  speak.  Initiative 
holds  the  person  who  is  leading  the  conversation.  The  grounding  component 
tracks  how  information  is  added  to  the  common  ground  of  the  participants.  The 
topic  contains  the  topic  of  the  associated  conversation  and  furthermore  there 
are  rhetorical  connections  relating  content  units  to  each  other.  Once  material 
is  grounded,  even  as  it  still  relates  to  the  topic  and  rhetorical  structure  of  an 
ongoing  conversation,  it  is  also  added  to  the  social  fabric  linking  agents,  which 
is  not  part  of  any  individual  converstaion.  This  includes  social  commitments  - 
both  obligations  to  act  or  restrictions  on  actions,  as  well  as  commitments  to  fac¬ 
tual  information.  There  is  also  a  negotiation  layer,  modeling  how  agents  come 
to  agree  on  these  commitments.  A  more  in-depth  survey  of  these  layers  can  be 
found  in  [Tra02]. 

In  addition  to  these  layers,  there  are  several  classes  of  rules  which  relate  the 
dialogue  acts  to  the  information  state.  These  are: 

Recognition  rules  that  associate  observed  behavior  (speech  and/or  other  modal¬ 
ities)  with  performance  of  one  or  more  of  these  dialogue  acts. 
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Update  rules  that  modify  the  information  state  components  with  information 
from  the  inferred  dialogue  acts. 

Selection  rules  that  decide  which  dialogue  acts  the  system  should  perform. 

Realization  rules  that  indicate  how  to  realize  the  selected  dialogue  act,  using 
natural  language,  non-verbal  communications,  and  other  behavior. 

Currently,  the  model  isn’t  implemented  entirely.  Some  aspects,  like  the 
rhetorical  layer  are  divided  amongst  several  layers  and  others  demand  more 
attention.  This  is  especially  true  for  the  contact  and  attention  layer. 

2.4.2  Natural  language  understanding 

The  agent  relies  on  external  speech  recognition  and  the  NLU  module.  The  goal 
of  this  module  is  to  convert  a  string  of  words,  as  uttered  into  the  microphone 
by  the  MRE  trainee  and  then  recognized  by  the  speech  recognition  module, 
into  one  or  more  semantic  frames  that  represent  the  meaning  of  the  sentence. 
This  module  currently  includes  three  engines  operating  in  parallel:  two  use 
finite  state  technology  and  one  is  a  statistically  trained  parser.  These  three 
engines  exhibit  complementary  strengths.  The  first  finite  state  engine  is  limited 
in  scope,  but  its  output  is  always  100  percent  correct;  it  is  most  useful  for 
sentences  where  speech  recognition  is  fully  correct.  The  second  can  recognize 
portions  of  inputs,  for  cases  in  which  speech  recognition  provides  a  partially 
correct  sentence.  The  third,  statistical  engine  is  more  robust,  and  can  easily 
be  extended  to  handle  new  sentence  types  and  new  words,  but  its  output  may 
include  erroneous  propositions.  This  module  is  stand-alone  Java  code. 

The  semantics  form  the  input  for  the  Soar  code  which  keeps  track  of  the 
dialogue  and  is  responsible  for  the  natural  language  generation.  Knowledge 
is  represented  using  state  propositions,  which  form  the  basis  for  the  system’s 
reasoning  capabilities.  The  states  currently  known  to  the  agents  can  be  found 
in  tables  4.2  and  4.3.  Two  abbreviated  examples  can  be  seen  below.  The  first 
is  a  state  proposition,  stating  that  the  boy  is  currently  not  healthy.  Example 
two  is  a  partial  proposition:  the  q-slot  field  represents  the  missing  information, 
e.g.  the  attribute  that  is  asked  about.  Here,  the  question  “Who  is  hurt?”  is 
represented  [TraOSc]. 

1.  "attribute  health-status  "object-id  boy  "polarity  negative 
"time  present  "type  state  "value  healthy 

2.  "q-slot  object-id  "attribute  health-status  "polarity  negative 
"time  present  "type  state  "value  healthy 

2.4.3  Natural  language  generation 

Depending  on  the  information  state  of  the  dialogue,  the  Soar  code  concerning 
language  generation  proposes  one  or  more  communicative  goals.  Once  a  goal 
has  been  selected  the  following  phases  will  be  executed: 


Content  selection  phase  during  which  is  determined  whether  the  commu¬ 
nicative  goal  can  be  met  and  what  content  satisfies  the  given  goal. 
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Sentence  planning  phase  during  which  is  decided  in  what  way  the  message 
is  best  conveyed.  This  generates  the  sentence  in  an  abstract  way. 

Realization  phase  during  which  the  abstract  sentence  is  mapped  to  words 
and  phrase  structures. 

Ranking  phase  during  which  the  possibly  multiple  ways  of  realizing  the  sen¬ 
tence  is  being  considered  and  a  best  match  is  selected. 

This  final  sentence  is  then  augmented  with  communicative  gestures,  includ¬ 
ing  lip  synch,  gaze,  and  hand  gestures,  converted  to  XML,  and  sent  to  the 
synthesizer  and  rendering  modules  to  produce  the  speech.  After  the  message 
is  spoken,  the  agent  receives  feedback  in  order  to  verify  if  the  sentence  was  ut¬ 
tered  successfully  after  which  the  dialogue  state  is  updated.  The  article  [Tra03b] 
discusses  the  NLG  phases  in  more  detail. 


Chapter  3 


Requirement  specification 

3.1  Assignment 

At  this  point,  the  agents  within  MRE  do  possess  emotional  behavior,  but  they 
are  unable  to  express  it  explicitly;  it  surfaces  only  by  means  of  body  language 
and  facial  gestures.  Our  task  is  to  specify  and  implement  utterances  that  express 
the  emotional  state  of  the  agent  and  the  reasons  for  that  state,  i.e.  the  user 
should  be  able  to  ask  the  agent  how  it  feels  and  why  he  is  feeling  that  way. 

3.2  Requirements 

The  final  result  should  be  a  scenario-independent  implementation  of  an  emo¬ 
tional  dialogue,  where  agents  can: 

•  understand  user’s  utterances  concerning  emotions; 

•  use  existing  knowledge  of  their  emotional  state  to  express  themselves;  and 

•  express  themselves  using  natural  language. 

An  emotional  dialogue  should  involve  the  following  possible  subjects: 

•  type  of  emotion; 

•  intensity  of  emotion; 

•  cause  of  emotion; 

•  involved  agents  for  a  certain  emotion. 
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Chapter  4 

Analysis 


In  this  chapter  the  parts  of  the  system  that  are  important  to  our  assignment 
are  analysed.  First,  the  emotional  state  is  discussed,  followed  by  the  agents 
personality.  Next  the  possible  emotion  based  speech  acts  are  analysed.  This 
chapter  concludes  with  a  short  description  of  natural  language  understanding 
(NLU)  and  natural  language  generation  (NLG). 


4.1  Emotional  state 

The  emotional  state  of  an  agent  is  the  result  of  the  cognitive  appraisal  of  the 
world;  it  is  calculated  by  taking  various  events  into  consideration.  Some  events 
in  the  world  have  a  direct  impact  on  the  agent’s  emotional  state  (i.e.  the  joy 
at  winning  a  game)  and  some  events  are  involved  through  a  causal  relation 
(i.e.  feeling  guilty  for  the  distress  of  one’s  opponent  after  winning  a  game).  All 
these  appraisals  are  annotated  by  attributes,  called  appraisal  variables]  these 
variables  characterize  the  event  and  as  a  result,  determine  the  type  and  intensity 
of  the  emotion.  The  different  appraisal  variables  are  described  in  table  4.1;  the 
variables  that  are  actually  implemented  in  the  current  model  are  marked  with 
a  f.  [Gra04] 
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Appraisal  variable 

relevance 

desirability 

agency 

blameworthiness 

likelihood 

inexpectedness 

urgency 

ego  involvement 

controllability 

power 

adaptability 

changability 


Description 

does  the  event  require  attention  or  adaptive  reaction 

does  the  event  facilitate  or  threat  the  agent’s  goals 

what  agent  is  responsible  for  the  event 

does  the  responsible  agent  deserve  blame  or  credit 

how  probable  is  the  event  to  happen 

was  the  event  predicted  from  past  knowledge 

will  delaying  a  response  make  matters  worse 

how  does  the  event  impact  a  person’s  sense  of  self 

to  what  extent  can  the  event  be  influenced 

what  power  has  an  agent  to  (in)directly  control  the  event 

can  the  person  live  with  the  consequences  of  the  event 

will  the  effect  change  of  it’s  own  accord 


Table  4.1:  Appraisal  variables 
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In  the  MRE  system  an  appraisal  is  linked  to  a  certain  state  and  an  event 
(or  act)  that  either  helps  or  threatens  progress  towards  the  state.  The  emotion 
raised  depends  on  whether  the  agent  wants  that  state  to  be  true  in  the  world 
or  not  -  this  means  the  desirability  variable  in  table  4.1  is  a  result  of  the 
desirability  of  the  state  and  whether  the  event  is  either  helping  or  threatening 
that  state. 

The  appraisals  (or  appraisal  frames)  in  the  MRE  system  are  stored  in  work¬ 
ing  memory  elements  (WME’s),  the  elements  that  contain  all  the  current  knowl¬ 
edge  in  the  world  in  the  Soar  system.  In  this  section  all  information  available 
on  emotions  will  be  presented;  this  information  can  be  used  to  construct  speech 
acts.  The  information  stored  in  the  WME  about  each  emotion  are  type  and 
intensity  and  what  event  it  was  raised  by.  Information  on  events  are  the  state, 
importance  state,  desirability  state  (which  actually  is  a  binary  mapping  of  the 
importance  state  attribute),  likelihood,  responsiblemgent,  blameworthiness, 
influence  (i.e.  if  the  event  helps  or  threatens  the  state,  this  is  the  actual  type 
of  the  appraisal),  and  status  (i.e.  has  it  already  happened  or  is  it  about  to 
happen) . 


4.1.1  Emotions 

There  are  seven  emotion  types:  joy,  hope,  distress,  fear,  anger,  guilt,  and 
anxiety;  they  are  stored  in  WMEs  by  the  same  name.  Every  emotion  has  a 
certain  intensity  between  0  and  1. 

For  every  appraisal  there  is  an  action  towards  a  certain  state  that  has  hap¬ 
pened  or  is  about  to  happen.  All  these  states  in  the  MRE  Bosnia  mission  are 
split  into  states  with  respect  to  the  mother’s  perspective,  which  are  listed  and 
explained  in  table  4.2,  and  states  with  respect  to  the  lieutenant’s,  sergeant’s 
and  medic’s  perspective,  which  are  listed  and  explained  in  table  4.3. 


State 

child-dead 

child-healthy 

troops-helping 

f acilities-ok 

Iz-secure 

medevac-called 

authority-present 

help-requested 


Meaning 

My  child  is  dead 
My  child  is  healthy. 

The  foreign  troops  are  helping  us. 

The  facilities  to  help  the  boy  are  available. 

The  landing  zone  for  the  medivac  is  secure. 
The  medevac  has  been  called. 

There  is  authority  present  at  the  accident  site. 
Help  for  my  son  had  been  requested. 


Table  4.2:  States  in  mother’s  perspective 

The  attribute  importance  state  has  a  value  between  -100  and  100.  The 
desirability  state  is  a  binary  mapping  of  the  former  attribute:  if  importance  state  < 

0  then  desirability  state  =  undesired  and  if  importance  state  >  0  then  desirability  state 

=  desired. 

The  possible  values  for  influence  are  facilitator,  which  means  the  emo¬ 
tion  is  raised  by  an  event  that  helps  progress  towards  a  certain  state,  and 
inhibitor,  which  threatens  progress. 

What  type  of  emotion  is  raised  by  an  event  depends  on  the  desirability  of  the 
event.  This  desirability  depends  on  the  importance  state  and  the  influence.  If 
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Name 

Meaning 

maint  ain-go  odwi  11 

The  goodwill  of  the  crowd  is  maintained 

crowd-angry 

The  crowd  is  angry 

boy-dead 

The  boy  is  dead 

boy-healthy 

The  boy  is  healthy. 

minor-in juries 

The  boy  has  minor  injuries. 

serious- in juries 

The  boy  has  serious  injuries. 

critical-inj uries 

The  boy  has  critical  injuries. 

driver-healthy 

The  driver  is  healthy. 

driver-minor- in j 

The  driver  has  minor  injuries. 

mother-healthy 

The  mother  is  healthy. 

know-boy-health 

The  health  of  the  boy  is  known. 

sqds-in-transit 

The  squads  are  in  transit  to  the  assembly  area. 

It-in-transit 

The  lieutenant  is  in  transit  to  the  assembly  area. 

It-at-aa 

The  lieutenant  is  at  the  assembly  area. 

It-at-celic 

The  lieutenant  is  at  Celic. 

sgt-at-aa 

The  sergeant  is  at  the  assembly  area. 

medic-at-aa 

The  medic  is  at  the  assembly  area. 

at-boy-aa 

The  boy  is  at  the  assembly  area. 

mom-at-aa 

The  mother  is  at  the  assembly  area. 

Ist-sqd-at-aa 

First  squad  is  at  the  assembly  area. 

Ist-sqd-at-celic 

First  squad  is  at  Celic. 

Ist-sqd-at-lz 

First  squad  is  at  the  landing  zone. 

(same  for  2nd,  3rd  and  4th) 

Ist-sqd- in-transit 

First  squad  is  in  transit. 

4th-sqd- in-transit 

Fourth  squad  is  in  transit. 

at-boy-hospital 

The  boy  is  at  the  hospital. 

mom-in-intersect 

The  mother  is  at  the  intersection. 

sqd-in-intersect 

The  squad  is  at  the  intersection. 

medevac-at-aa 

The  medevac  is  at  the  assembly  area. 

medevac-at-base 

The  medevac  is  at  the  base. 

medevac-called 

The  medevac  has  been  called  for. 

medevac-overhead 

The  medevac  is  overhead. 

amb-at-aa 

The  ambulance  is  at  the  assembly  area. 

amb-at-base 

The  ambulance  is  at  the  base. 

ambulance-called 

The  ambulance  ahs  been  called  for. 

secure-route 

The  route  to  Celic  has  been  secured. 

aa-secure 

The  assembly  area  has  been  secured. 

accident-secure 

The  accident  site  has  been  secured. 

12-to-4-secure 

12  to  4  hours  secure. 

4-to-8-secure 

4  to  8  hours  secure. 

8-to-12-secure 

8  to  12  hours  secure. 

Iz-secure 

The  landing  zone  has  been  secured. 

Iz-marked 

The  landing  zone  has  been  marked  by  green  smoke. 

Iz-clear 

The  landing  zone  is  cleared  of  civilians. 

support- 1-6 

Eagle  2-6  is  supporting  Eagle  1-6 

retain-mass 

Eagle  2-6  is  together  (as  a  team). 

f racture-unit 

Eagle  2-6  has  been  split  up 

1-6-at-celic 

Eagle  1-6  is  at  Celic 

hospital-at-tuzla 

The  hospital  is  at  Tuzla 

Table  4.3:  States  in  sergeant’s,  lieutenant’s  and  medic’s  perspective 
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the  state  is  not  desired  and  the  event  is  threatening  progress  towards  that  state, 
the  event  will  of  course  be  desired,  i.e.  desirability  >  0.  The  categorization  of 
the  emotions  is  described  in  table  4.4;  we  consider  the  source  of  the  event  known 
(i.e.  state  ^  NULL)  unless  stated  otherwise. 

Joy  and  hope  are  the  results  of  a  positive  desirability:  joy  if  the  outcome  is 
certain,  hope  if  it  is  not  certain.  Fear  is  the  result  of  knowing  the  source  of  the 
undesired  event  that  might  happen,  while  distress  is  the  result  of  an  event  that 
already  has  happened  or  is  going  to  happen  for  sure.  If  the  source  is  unknown, 
the  agent  will  feel  anxiety.  Anger  is  the  result  of  an  undesired  event  which  has 
a  responsible  agent  (notice  it  is  possible  to  be  angry  with  yourself),  while  guilt 
is  the  result  of  being  the  responsible  agent  for  an  event  that  is  undesired  in 
someone  else’s  perspective.  All  variables  always  depend  on  a  certain  agent’s 
perspective  (p  and  q). 

The  total  intensity  for  each  emotion  is  calculated  by  taking  the  intensity  for 
every  single  appraisal  frame  that  has  that  emotion  as  type  into  account.  The 
intensity  for  a  single  event  is  calculated  by  the  formula 

\desir ability (p)  x  likelihood{p)\ 

In  this  formula,  likelihood  is  the  probability  of  the  event  happening  in  the 
future.  [Gra04]. 


Appraisal  configuration  Emotion 

de  sir  ability  (p)  >  0,  likelihoodijp)  =  1  joy 

desirability (p)  >  0,  likelihood(j>)  <  1  hope 

desirability (p)  <  0,  likelihoodijp)  =  1  distress 

desirabilityip)  <  0,  likelihoodip)  <  1  fear 

de  sir  ability  (p)  <  0,  likelihoodip)  <  1,  state  =  NULL  anxiety 

desirabilityip)  <  0,  blameworthinessiq)  —  blameworthy  anger 


desirability iq)  <  0,  blameworthinessip)  =  blameworthy,  p  ^  q  guilt 
Table  4.4:  Emotion  categorization 


4.1.2  Events 

Each  emotion  is  linked  to  one  of  the  states  in  table  4.3  or  table  4.2.  These 
states  are  the  result  of  events,  which  usually  have  a  responsible  person  -  all  the 
possible  values  for  the  responsible  Mg  ent  attribute  are  in  table  4.5. 

The  value  of  the  blameworthiness  attribute  declares  whether  the  resposible 
agent  should  be  blamed  (blameworthy)  or  receive  credit  (praiseworthy)  for 
the  event.  Finally,  the  attribute  status  states  whether  the  event  has  already 
happened,  confirmed,  or  has  yet  to  happen,  unconfirmed. 

4.1.3  Structure 

The  WMEs  in  Soar  can  be  graphically  presented  by  a  directed  graph.  To  en¬ 
hance  in  clarity,  the  structure  of  the  locations  of  the  data  is  presented  as  a  tree; 
see  figure  4.1. 

The  total  values  of  each  emotion  are  stored  as  in  figure  4.2. 
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SI 

+  appraisals 
I  +  types 

I  I 

I  +  {Anger,  Anxiety,  ...I 

I  I  I 

I  I  +  emotion-type 
I  I  +  importance 

I  I  +  intensity 

I  I  +  agent 

I  I  +  appraisal 

I  I  I  I 

111+  obiect 

. 

1111+  name 

I  I  I  I 

111+  type 
111+  desired-self 
111+  evaluation 

I  I  I  I  I 

1111+  responsible-agent 
1111+  evaluation 

I  I  I  I 

111+  feature 

I  I  I  I  I 

1111+  status 


top  state 

all  possible  types  for  emotion 

type  of  this  emotion 

type  of  this  emotion 
state  importance 
of  this  emotion 

agent  the  appraisal  is  judged  by 
by  which  emotion  was  raised 


the  state 

event  helps  or  threatens  state 
binary  mapping  of  importance 

responsible  agent  for  the  event 
whether  responsible  agent  is 
blamed  or  praised 

is  event  confirmed/unconfirmed 


Figure  4.1:  Tree  structure  of  the  locations  of  the  emotion  WMEs 
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Value 

Person 

Isldr 

First  squad  (leader) 

2sldr 

Second  squad  (leader) 

3sldr 

Third  squad  (leader) 

4sldr 

Fourth  squad  (leader) 

ambulance 

The  ambulance 

base 

The  base 

It 

Lieutenant  (you) 

medevac 

The  medevac  (helicopter) 

medicf 

The  team’s  medic 

momf 

The  mother 

sgtj 

The  sergeant 

Table  4.5:  Possible  values  for 
intelligent  agents  in  the  MRE 

responsible-agent]  entries  marked  with  a  f  are 
system 

4.2  Personality 

Apart  from  the  emotional  state,  an  agent  has  a  personality.  This  personality  has 
influence  on  his  coping  strategy  and  (body)  language.  It  can  only  be  changed 
manually  by  the  use  of  sliders,  which  is  justified,  as  personality  does  not  change 
in  a  short  time  interval  as  with  a  mission  scenario. 

SI 

+  io 

1  1 

top  state 

1  1 

1  +  input -link 

1  1  1 

input  link 

1  1  1 

1  1  +  {Defensiveness,  ...I 

1  1  +  self 

1  1  1  1 

type  of  personality  with  intensity  as  value 

1  1  1  1 

111+  {Anger,  Anxiety, 
111+  max 

. ..}  total  intensity  of  the  emotion 

emotion  with  the  highest  total  intensity 

Figure  4.2:  Tree  structure  of  the  locations  in  the  input  link 

The  personality  is  defined  by  lour  personality  _types:  defensiveness,  terseness, 
initiative,  and  expressiveness.  As  with  the  emotions,  the  intensity  of  a 
personality  personality -intensity  has  a  value  between  0  and  1.  The  location  of 
these  values  are  in  the  input  link  of  the  Soar-environment,  see  figure  4.2. 


4.3  Speech  acts 

In  this  section  possible  utterances  concerning  emotions  are  evaluated.  Some 
assumptions  are  made: 

1.  the  speech  acts  are  both  domain  and  scenario  independent 

2.  the  emotional  dialogue  exists  as  a  side  line  to  existing  dialogue 

3.  the  emotional  dialogue  is  always  user  driven 
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The  first  one  is  taken  from  section  3.2.  The  second  assumption  is  made 
because,  first  of  all,  the  current  scenario  isn’t  very  suitable  for  having  a  nat¬ 
ural  emotional  conversation.  Also,  blending  emotional  dialogue  into  existing 
dialogue  in  a  natural  way,  would  imply  emotional,  dialogue  and  social  studies, 
which  cannot  be  performed  within  the  given  time  frame.  The  lack  of  dialogue 
context  implies  the  third  assumption,  i.e.  the  emotional  conversation  is  initiated 
by  the  user  and  has  a  question-answer  construction.  As  mentioned  in  section  4.1, 
information  about  emotions  are  classified  in  the  subjects  type,  intensity,  state, 
importance  state,  desirability  state,  likelihood,  responsible-agent,  blameworthiness, 
influence,  and  status.  Of  these  subjects,  type,  intensity,  state,  responsible-agent 
and  blameworthiness  can  directly  be  used  within  conversations  about  emotions. 

We  use  this  distinction  for  classifying  the  utterances  in  the  following  subsections. 

The  outline  for  a  question-answer  interaction  consists  of  all  possible  questions 
with  the  same  meaning,  annotated  with  their  keywords,  and  the  possible  answers 
for  the  questions,  with  the  data  that  answer  supplies  and  thus  is  needed  to 
construct  the  answer. 

Note:  During  implementation  and  testing  certain  revisions  were  made  to 
the  speech  acts.  In  order  to  show  the  iteration  process,  the  original  speech  acts 
are  still  depicted  here.  The  final  speech  acts  can  be  found  in  appendix  A. 

4.3.1  Emotion  type 

Our  first  question  tries  to  find  out  how  an  agent  feels.  It’s  assumed  his  answer 
will  give  information  about  the  emotion  he  feels  the  most,  i.e.  the  emotion  with 
the  highest  intensity.  In  addition  to  this  information,  the  agent  can  answer  more 
extensively,  giving  information  on  why  he  feels  that  way,  how  much  he  feels  that 
way,  et  cetera. 

Question  How  do  you  feel? 

Keywords:  how,  feel 

Question  What’s  wrong  with  you? 

Keywords:  what,  wrong,  you 

Answer  I’m  [emotion]. 

Data:  type,  intensity 

Answer  I’m  a  bit /really /very/. . .  [emotion]. 

Data:  type,  intensity 

Answer  I’m  a  bit /really /very/. . .  [emotion],  because  [additional  information 
on  state,  responsible  agent,  . . .  ] 

Data:  type,  intensity,  influence,  state,  responsible-agent, . . . 

The  second  question  is  simular  to  the  first  one,  but  now  is  focused  on  a 
particular  state.  Further  attention  should  be  given  to  the  fact  that  this  question 
could  also  imply  a  desire  to  get  to  know  the  agent’s  plan  of  action. 

Question  How  do  you  feel  about  [state]? 

Keywords:  feel,  [state] 
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Answer  That  doesn’t  seem  really  important  at  this  time,  sir. 

Answer  I’m  [emotion]  about  [state]. 

Data:  type,  intensity 

Answer  I’m  a  bit /really /very/. . .  [emotion]  about  [state]. 

Data:  type,  intensity,  state 

Answer  I’m  a  bit/really/very/. . .  [emotion]  about  [state],  because  [additional 
information  on  state,  responsible  agent,  . . .  ] 

Data:  type,  intensity,  influence,  state,  responsible  .agent, . . . 

The  third  question  wants  confirmation  on  a  certain  feeling.  The  answer 
consists  of  a  confirmation  and  if  positive,  can  be  extended  with  information  on 
why  the  agent  feels  the  emotion.  To  be  able  to  answer  this  question,  a  certain 
threshold  needs  to  be  set  for  the  intensity. 

Question  Do  you  feel  [emotion]? 

Keywords:  feel,  [emotion] 

Question  Are  you  [emotion]? 

Keywords:  are  (to  be),  [emotion] 

Answer  Yes  /  No,  sir. 

Data:  type,  intensity 

Answer  Yes,  sir,  because  [additional  information  on  state,  responsible  agent, 

...] 

Data:  type,  intensity,  influence,  state,  responsible.agent, . . . 

4.3.2  Intensity 

A  user  should  be  able  to  reassure  an  agent,  when  the  intensity  of  a  certain 
emotion  is  too  high.  Although  this  isn’t  a  real  question,  for  clarity  the  same 
structure  as  in  the  other  subsections  is  used. 

The  following  utterances  can  be  used  for  every  emotion. 

Question  Calm  down. 

Keywords:  calm,  down 
Question  Relax. 

Keywords:  relax 
Answer  Yes,  sir. 

Data:  type,  intensity 
Answer  Will  do,  sir. 

Data:  type,  intensity 
Answer  I  am  calm/relaxed,  sir. 

Data:  type,  intensity 

Whether  such  an  utterance  of  the  lieutenant  will  have  in  fact  an  impact  on 
the  agent’s  emotion  is  a  point  of  further  attention. 
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4.3.3  State 

If  the  user  asks  his  interlocutor  for  the  reasons  of  his  emotional  state,  he’s 
actually  asking  for  the  state  an  event  helps  or  treatens,  which  as  a  result  creates 
the  agent’s  emotional  state.  In  the  answer  a  lot  of  information  on  this  state  has 
to  be  grouped. 

Question  Why  are  you  [emotion]? 

Keywords:  why,  are  (to  be),  [emotion] 

Question  What’s  causing  you  to  feel  [emotion]? 

Keywords:  what,  causing,  [emotion] 

Answer  Because  [state]. 

Data:  emotion,  state,  influence 

Answer  It’s  [responsible  agent] ’s  fault  that  [state]! 

Data:  emotion,  state,  influence,  responsible-agent,  blameworthiness 

Answer  I’m  not  [emotion]! 

Data:  emotion,  intensity 

Answer  That’s  personal,  sir. 

Data:  emotion 

4.3.4  Responsible  agent  and  blameworthiness 

The  user  might  want  to  ask  the  interlocutor  more  details  about  the  state,  in  par¬ 
ticular  who  is  responsible  for  the  state  and  thus  for  the  emotion.  This  question 
may  depend  on  the  emotion. 

Question  Who’s  responsible  for  [state]? 

Keywords:  who,  responsible,  [state] 

Question  Who’s  responsible  for  making  you  feel  [emotion]? 

Keywords:  who,  responsible,  [emotion] 

Question  Towards  whom  do  you  feel  guilty? 

Data:  whom,  guilty 

Answer  [responsible  agent]. 

Data:  emotion,  state,  influence,  responsible -agent,  blameworthiness 

Answer  It’s  [responsible  agent] ’s  fault  that  [state]! 

Data:  emotion,  state,  influence,  responsible-agent,  blameworthiness 
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4.4  Natural  language 

In  chapter  2  the  theories  behind  the  natural  language  modules  of  MRE  were 
presented.  In  a  perfect  world  all  speech  would  pass  the  speech  recognizer,  turn¬ 
ing  it  into  a  string  of  words,  which  would  be  transformed  into  a  set  of  semantic 
frames  by  the  NLU  module.  These  frames  would  travel  through  the  system,  up¬ 
dating  the  dialogue  state,  generating  a  communicative  goal,  selecting  the  proper 
content  for  output,  and  realizing  the  specific  sentence  which  conveys  that  con¬ 
tent.  Unfortunately,  we  don’t  live  in  a  perfect  world.  Real  life  isn’t  neat,  it’s 
filthy,  dirty  and  full  of  hacks. 

Although  the  ’neat’  method  described  above  is  of  course  prefered  over  other 
ways  of  implementation,  some  problems  concerning  this  method  arise.  First  of 
all,  the  MRE  project  has  currently  no  direct  control  over  the  core  of  the  NLU 
module.  This  means  that  any  natural  language  understanding  added  to  MRE 
has  to  bypass  this  module,  using  Soar.  Secondly,  it  is  unclear  if  the  NLG  module 
can  be  used  since  there  is  no  expert  code  maintainer  at  this  moment. 

This  section  discusses  the  various  ways  natural  language  understanding  and 
natural  language  generation  are  implemented  and  how  we  can  make  use  of  them, 
bypassing  both  the  NLU  and  part  of  the  NLG. 

4.4.1  Natural  language  understanding 

The  MRE  system  has  two  methods  of  bypassing  the  NLU  module.  One  can 
either  type  in  question  propositions  or  one  can  define  rules  which  scan  for  certain 
keywords  in  an  utterance.  Both  these  methods  will  create  semantics  which  can 
continue  the  normal  flow  of  the  system. 

The  entered  propositions  should  match  the  sequence  state-q  object-id 
attribute  value  polarity,  where  state-q  serves  for  making  clear  a  propo¬ 
sition  is  typed  in,  rather  than  natural  language.  The  subject  of  the  question 
should  be  indicated  by  typing  q  in  it’s  place,  i.e.  the  question  “Are  you  feel¬ 
ing  angry?”  can  be  entered  as  state-q  sgt  I  Angry  I  yes  q,  when  adressing 
the  sergeant.  The  typed  in  proposition  is  mapped  to  the  proper  semantics  by 
placing  the  tokens  in  the  “semantics  attribute. 

Keyword  scanning  is  not  actively  used  anymore,  although  some  rules  still  ex¬ 
ist.  Figure  4.3  depicts  a  combination  of  these  rules.  It  scans  for  the  words  “hap¬ 
pened”  and  “here”  in  order  to  detect  the  utterance  “What  happened  here?”. 
When  this  rule  fires,  it  generates  the  proper  semantics  by  defining  a  question 
(“type  question)  with  an  event  as  subject  (“q-slot  event).  The  question  is 
further  defined  as  what  event  (“type  event)  happened  at  the  Assembly  Area 
(“location  aa,  which  is  where  the  scene  takes  place)  in  the  past  (“time  past). 

4.4.2  Natural  language  generation 

The  dialogue  code  will  generate  a  certain  obligation  (also  called  goat)  for  the 
agent,  for  instance  the  obligation  to  assert  a  question.  In  order  to  adress  this 
obligation,  a  communicative  goal  is  formed,  which  holds  the  actual  response. 
This  is  done  by  selecting  one  or  more  states  (as  discussed  in  2.4.2)  from  all 
matching  states.  The  system  then  generates  natural  language  for  the  chosen 
alternative.  The  goal  can  be  seen  as  why  the  agent  is  making  an  utterance,  the 
comgoal  is  what  this  utterance  is. 
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sp  {top-state*apply*operator*understand-speech*nlu*what-happened-here 
(state  <s>  “name  top-state 
“operator  <o>) 

(<o>  “name  understand-speech 
“speech-input  <si>) 

(<si>  “id  <id> 

“speaker  It 
“interpretation  <i>) 

(<i>  “token. lex  <<  happened  » 

“token. lex  <<  here  >>) 

— > 

(<i>  “addressee  sgt 
“mood  question 
“semantics  <sem>  +  =  >) 

(<sem>  “type  question 
“q-slot  event 
“prop  <seml>) 

(<seml>  “type  event 
“location  aa 
“time  past)} 


Figure  4.3:  Soar  rule  which  maps  the  question  “What  happened  here?”  to  the 
proper  semantics 


In  terms  of  this  assignment,  there  are  three  possibilities  for  generating  lan¬ 
guage.  The  first  method  consists  of  defining  new  states,  based  upon  the  existing 
emotion  code.  This  will  make  the  system  able  to  reason  about  emotions  the  same 
way  it  does  in  general.  Two  problems  have  to  be  adressed,  though,  when  using 
this  method.  First,  as  an  agent  appraises  all  states  in  order  to  compute  his 
emotions,  adding  emotion  states  (which  then  would  also  be  appraised)  could 
unbalance  the  system.  Secondly,  the  system  isn’t  capable  of  handling  causality, 
so  there’s  no  way  to  get  to  know  why  an  agent  is,  for  example,  feeling  guilty. 
In  order  to  make  use  of  general  reasoning  rules,  the  system  should  be  extended 
with  causality  features.  The  general  outline  of  a  proposition  state  can  be  found 
in  figure  4.4. 

The  second  method  consists  of  directly  mapping  a  goal  to  the  proper  seman¬ 
tics  for  the  speech  act.  The  NLG  module  then  uses  these  semantics  to  generate 
certain  sentences.  This  method  bypasses  the  reasoning  part  of  the  system. 

The  third  method  bypasses  both  the  content  selection  and  sentence  gener¬ 
ating  code,  by  mapping  a  certain  goal  directly  to  a  speech  act  (surface).  An 
example  of  such  a  rule  can  be  found  in  figure  4.5,  where  a  communicative  goal 
of  the  sergeant  answering  the  lieutenant  whether  he  is  hopeful  is  met  by  utter¬ 
ing  “I’m  hopeful”.  The  fact  that  this  rule  will  make  the  sergeant  reply  in  this 
fashion  even  if  he’s  in  fact  not  hopeful,  can  be  seen  as  a  small  indication  that 
some  work  still  remains  to  be  done. 
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SI 

+  current-state 

I  I 

I  +  {statel,  state2,  .  .  . 

I  I  I 

I  I  +  attribute 

I  I  +  belief 

I  I  +  concern 

I  I  +  emotion 

I  I  +  established-by 

I  I  +  id 

I  I  +  initial-belief 

I  I  +  name 

I  I  +  negation 

I  I  +  object-id 

I  I  +  polarity 

I  I  +  satisfied 

I  I  +  sim-object 

I  I  +  source 

I  I  +  type 

I  I  +  value 


top  state 

state  name 

subject  of  the  state 

whether  agent  thinks  state  is  true  or  false 
intrinsic  (context  free)  value  of  state 
emotion  of  every  agent  for  this  state 
effect  that  caused  current  value  of  state 
state  name 

initial  belief  of  the  agent 
state  name 

link  to  inverse  state 

concerned  agent 

positive  or  negative  focused 

is  state  satisfied  (may  differ  from  belief) 

name  of  the  object  in  the  VR-simulation 

source  of  state  (inference) 

"state" 

value  of  the  state 


Figure  4.4:  Tree  structure  of  general  propositions 


sp  {apply *output-speech*answer-emot ion-type 
(state  <s>  “agent-name  sgt 
“operator  <o>) 

(<o>  “name  output-speech 
“comgoal  <cg>  ) 

(<cg>  “speaker  sgt 
“addressee  It 
“speech-act  <b>) 

(<b>  “type  backward 
“action  answer 
“actor  sgt 
“question  <sem>) 

(<sem>  “type  question 
“q-slot  value 
“prop  <seml>) 

(<seml>  “type  value 

“object-id  sgt 
“attribute  iHopel) 

— > 

(<cg>  “surface  I "I’m  hopeful" I  +  =)} 

Figure  4.5:  Tree  structure  of  general  propositions 


Chapter  5 

Design 


This  chapter  describes  the  design  of  our  system.  Where  possible,  it  uses  methods 
already  available. 

We  recall  from  subsection  4.4.1  that  there  are  two  alternatives  for  language 
understanding: 

•  Propositions 

•  Keyword  scanning 

As  the  use  of  propositions  would  imply  abandoning  the  requirement  of  using 
natural  language,  this  alternative  is  discarded  and  keyword  scanning  is  chosen. 
For  language  generation  three  alternatives  were  presented: 

•  State  reasoning 

•  Creating  formal  semantics  manually 

•  Surfacing  a  string  directly 

Despite  the  problems  mentioned  in  subsection  4.4.2  it  showed  that  using 
state  reasoning  is  possible.  The  MRE  team  allowed  the  addition  of  a  “cause  at¬ 
tribute  to  the  state  structre  and  implemented  a  generic  follow-up  why-question. 
It  was  asserted  that  possible  issues  with  appraising  emotion  states  could  be 
dealt  with.  Also,  it  showed  that  using  the  NLG  sentence  planning  ability  could 
not  be  used  within  the  given  time  frame,  as  it  is  quite  domain  specific.  The 
design  of  the  language  generation  therefore  is  a  mixture  between  the  first  and 
third  alternative.  Emotion  states  will  be  created  in  order  to  make  reasoning 
possible.  When  the  system  has  come  up  with  the  communicative  goal,  though, 
the  formal  semantics  will  not  be  send  to  the  NLG  sentence  generation.  Rather, 
the  semantics  form  a  trigger  to  use  certain  templates. 

As  states  form  the  informational  basis  for  both  the  reasoning  part  and  the 
creation  of  formal  semantics,  this  subject  will  be  discussed  first  in  section  5.1. 
Section  5.2  uses  the  states  as  a  starting  point  to  design  the  natural  language  un¬ 
derstanding  part.  In  section  5.3  the  required  templates  are  designed.  Section  5.4 
concludes  with  an  overview  of  the  design. 

Gertain  issues  during  later  phases  of  the  assignment  caused  some  changes  to 
the  original  design.  In  order  to  show  some  insight  in  the  process,  the  original 
design  is  shown  in  the  following  sections,  revisions  can  be  found  in  section  5.5. 
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5.1  Emotion  states 

Making  the  required  data  for  the  output  available  is  done  by  creating  states  as 
mentioned  above.  The  current  state  design  as  depicted  in  figure  4.4  is  used, 
with  the  addition  of  a  cause  attribute.  These  new  states  are  called  emotion 
states.  The  states  contain  the  data  that  is  in  the  speech  act;  additional  data 
(i.e.  terseness  of  the  agent  to  determine  the  template)  is  extracted  from  the  rest 
of  the  system.  The  actual  template  fillings  will  be  placed  in  lookup  tables  -  see 
subsection  5.3.2  for  more  details  on  this  subject. 

Since  it  is  not  desirable  to  have  states  for  every  single  subject  that  can  be 
talked  about,  certain  states  are  created  on-the-fly.  For  example,  if  the  user 
asks  for  the  cause  of  a  certain  feeling,  the  state  containing  that  information 
is  only  available  as  long  as  the  question  is  under  discussion,  otherwise  every 
reason  for  every  feeling  should  be  available  in  permanent  states.  Some  states 
are  permenant,  though,  since  there  is  only  one  piece  of  information  needed,  i.e. 
the  answer  to  the  question  “How  do  you  feel?”  only  requires  a  single  state  of 
information. 

The  following  subsections  describe  every  emotion  state  related  to  a  ques¬ 
tion.  Following  the  original  design  of  the  states,  every  state  has  a  negated 
state  {belief  =  false  instead  of  the  belief  =  true);  only  the  states  with 
belief  =  true  are  listed  for  each  question.  The  value  for  initialbelief  must  be 
equal  to  that  of  belief,  because  of  a  syntax  requirement  of  the  system. 

The  values  for  certain  emotion  states  depend  on  what  the  intensity  of  the 
emotion  is.  If  an  agent  feels  a  certain  emotion  with  an  intensity  less  than  0.2,  he 
does  not  believe  he  feels  the  emotion.  This  threshold  has  effect  on  the  creation 
of  emotion  states,  but  also  on  the  selection  of  the  template  alternative  and  the 
template  fillings. 

Note:  In  the  figures  in  these  sections  plain  text  defines  an  attribute  value. 
A  text  between  <  and  >  defines  a  value  that  has  to  be  looked  up  using  an 
algorithm.  Text  between  [  and  ]  defines  a  value  that  can  be  acquired  from  the 
user’s  speech  act,  and  text  preceded  by  a  *  define  a  path  of  attributes  to  a  value 
in  the  system. 


5.1.1  Emotion  type 

When  the  question  “How  do  you  feel?”  is  uttered,  the  adressee  is  asked  for 
his  most  important  feeling,  so  the  emotion  state  attribute  will  be  max-feeling. 
The  value  of  the  state  is  the  most  important  emotion,  which  is  the  emotion 
the  agent  feels  most  and  can  be  found  in  si .  io .  input-link,  self  .max.  As 
for  every  emotion  state  the  value  in  si .  agent -name  applies  for  the  object  —  id 
attribute.  Since  the  most  important  feeling  always  exists,  polarity  is  positive. 
The  cause  attribute  links  to  the  object  of  the  most  important  state  generating 
this  feeling,  the  state  that  has  the  greatest  part  in  boosting  the  most  important 
emotion  -  a  link  to  the  appraisal  object  of  this  state  is  provided  in  the  source 
attribute. 

This  emotion  state  will  be  available  permanently. 
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How  do  you  feel? 

attribute 

belief 

cause 

initial  —  belief 

object  —  id 

polarity 

satisfied 

source 

type 

value 


max-feeling 

true 

<most  important  state  for  this  emotion> 
true 

*  s 1 . agent -name 

positive 

true 

<appraisal  for  most  importauit  state> 
state 

*sl . io . input-link. self .max 


The  emotion  state  for  a  question  as  “How  do  you  feel  about  [state]?”  will 
be  created  on-the-fly.  The  value  for  the  answer  can  be  found  in  the  appraisal  of 
the  mentioned  state. 

How  do  you  feel  about  [state]? 

attribute 
belief 
cause 

initial  —  belief 
object  —  id 
polarity 
satisfied 
sim  —  object 
source 
type 
value 


f eeling-about-state 
true 

♦current-state. [state] 
true 

*sl . agent -name 

positive 

true 

♦current-state. [state] .sim-object 

<appraisal  for  state> 

state 

♦  current-state,  [state]  .  [emotion]? 


For  every  emotion  an  emotion  state  feeling  is  created.  The  value  of  polarity 
states  whether  the  agent  believes  he  feels  this  emotion  or  not;  this  depends  on 
the  threshold  for  the  intensity.  If  the  agent  does  feel  the  emotion,  causality  is 
added  in  the  cause  attribute  and  the  appraisal  source  is  added  in  the  source 
attribute. 


Do  you  feel  [emotion]? 

attribute 

belief 

cause 

initial  —  belief 
object  —  id 
polarity 

satisfied 
sim  —  object 
source 

type 

value 


feeling 

true 

<most  important  state  for  this  emotion> 

if  intensity^.^jjiQiiQji'^  ^  0.2 

true 

♦si . agent -name 

positive,  if  intensityi^rnotion]  >  0.2 
negative,  if  intensityi^rnotion]  <  0.2 
true 

<appraisal  for  most  important  state> 

if  intensity^^.fy2.otion]  ^  0.2 

state 

♦si . io . input-link. self . [emotion] 


5.1.2  Intensity 

For  the  reactions  on  an  utterance  as  “Calm  down.”  the  emotion  states  max-feeling, 
as  described  above,  are  used. 
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5.1.3  State 

For  the  reaction  on  a  question  “Why  are  you  [emotion]?”  the  value  of  polarity 
and  cause  in  the  feeling  state  attribute  for  that  specific  emotion  is  used,  so 
no  new  emotion  states  need  to  be  designed  here. 

5.1.4  Responsible  agent  and  blameworthiness 

For  the  answer  to  the  question  “Who’s  responsible  for  making  you  feel  [emo¬ 
tion]?”  new  (permanent)  emotion  states  are  needed.  For  every  emotion  an 
emotion  state  responsible-f or- [emotion]  is  created  only  if  the  intensity  of 
that  emotion  is  higher  than  the  threshold  of  0.2.  The  value  is  the  agent  that 
is  responsible  for  the  state  that  influences  the  emotion  the  most.  In  the  cause 
attribute,  the  blameworthiness  of  the  responsible  agent  is  stored.  Note  that  in 
this  case  the  cause  attribute  is  not  a  state. 


Who’s  responsible  for  [state]? 

attribute 

belief 

cause 

initial  —  belief 

object  —  id 

polarity 

satisfied 

type 

value 


responsible-f or- [emotion] 
true 

<blameworthiness> 

true 

*sl . agent -name 

positive 

true 

state 

<responsible  agent  for  most  importEuit  state> 


5.2  Natural  language  understanding 

With  bypassing  the  NLU  module  cannot  be  used,  semantic  frames  have  to  be 
created  by  Soar,  given  a  certain  utterance.  More  specific  this  means  scanning  the 
input  for  specific  keywords,  and  on  detection  of  the  right  keywords  generating 
the  proper  semantics,  which  continue  the  normal  flow  within  the  system,  i.e. 
dialogue  and  language  generation  code. 

In  the  following  subsections  the  semantics  for  each  type  of  question  are  pre¬ 
sented,  accompanied  by  the  keywords  mentioned  in  section  4.3.  The  first  colomn 
of  a  table  shows  the  natural  language  question,  with  the  variable  emotion 
or  state  between  straight  brackets.  The  second  column  shows  the  keywords 
needed  in  order  to  detect  the  question.  All  the  words  connected  with  A  are 
needed  for  detection;  V  denotes  a  choice  between  certain  words.  The  semantics 
associated  with  the  question(s)  are  shown  in  the  third  column,  based  upon  the 
states  discussed  in  section  5.1. 

The  last  subsection  discusses  the  mapping  from  emotions  and  states  in  nat¬ 
ural  language  to  the  representation  used  by  the  system. 

5.2.1  Emotion  type 

The  semantics  for  the  emotion  type  questions  are  straightforward:  the  first 
and  second  are  about  the  value  of  respectively  the  states  max-feeling  and 
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f eeling-about-state.  As  there’s  only  one  max-feeling  no  additional  infor¬ 
mation  is  needed.  In  order  to  get  the  right  f eeling-about-state,  the  cause 
attribute  is  set  to  the  state  asked  about. 

The  third  question  is  about  whether  a  certain  state  is  true  or  false,  so  the 
q-slot  is  set  to  polarity.  The  value  of  the  value  attribute  will  make  sure  the 
right  feeling  state  is  selected. 


Question 

Keywords 

Semantics 

How  do  you  feel? 

how  A  feel 

“type  question  “q-slot  value 
“attribute  max-feeling 

What’s  wrong 
with  you? 

(what  V  what’s) 

A  wrong  A  you 

How  do  you  feel 
about  [state] 

feel  A  [state] 

“type  question  “q-slot  value 
“attribute  f eeling-about-state 
“cause  <state> 

Do  you  feel  [emotion]? 

feel  A  [emotion] 

“type  question  “q-slot  polarity 
“attribute  feeling  “value  <emotion> 

Are  you  [emotion]? 

are  A  ]emotion] 

5.2.2  Intensity 

Since  this  type  of  question  is  more  or  less  a  gimmick,  no  states  have  been 
designed.  In  order  to  detect  this  question,  a  dummy  is  used  to  create  fake 
semantics.  Although  the  formal  semantics  do  not  match  the  informal  semantics, 
it  is  possible  to  detect  the  question  later  on  and  present  the  proper  reply. 


Question 

Keywords 

Semantics 

Calm  down. 

calm  A  down 

“type  question  “q-slot  dummy-int 
“attribute  max-feeling 

Relax. 

relax 

5.2.3  State 

When  one  asks  “Why  do  you  feel  angry?”,  we  expect  to  get  the  cause  of  the 
emotion  as  an  answer.  This  semantics  is  presented  formally  in  the  table  below. 


Question 

Keywords 

Semantics 

Why  are  you  [emotion]? 

why  A  are  A  [emotion] 

“type  question  “q-slot  cause 
“attribute  feeling 
“value  <emotion> 

What’s  causing  you  to 
feel  [emotion] 

(what  V  what’s)  A  causing 

A  (emotion] 

5.2.4  Responsible  agent  and  blameworthiness 

Both  of  the  quesions  below  are  semanticly  the  same,  but  phrased  differently. 
Since  a  responsibility  state  exists  for  every  emotion,  it  is  merely  a  matter  of 
asking  for  the  value  of  that  state. 


Question 

Keywords 

Semantics 

Who’s  responsible  for  making 
you  feel  [emotion]? 

(who  V  who’s)  A 
responsible  A  [emotion] 

“type  question 

“q-slot  value  “attribute 

responsible-f or- [emotion] 

Towards  whom  do  you  feel  guilty? 

(whom  V  who)  A  guilty 
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5.2.5  Synonyms 

As  the  emotions  and  states  are  internally  represented  in  a  certain  way,  we  need 
to  map  natural  language  words  to  these  internal  representations.  This  also 
provides  us  with  the  ability  to  use  synonyms. 

For  this  mapping  we  make  additional  look-up  tables.  The  emotion  synonyms 
can  be  seen  in  the  table  below.  Although  in  natural  language  not  all  synonyms 
map  exactly  to  one  emotion  or  state,  we  use  this  many-to-one  mapping  for  sake 
of  simplicity.  This  will  result  in  the  agent  interpreting  a  user’s  ambiguous  ques¬ 
tion  (like  “Do  you  feel  stressed?”)  in  a  way  the  user  might  not  have  intended^. 

Natural  language  Internal  representation 

anger,  angry,  annoyed,  irritated  I  Anger  I 

anxiety,  anxious,  worried,  concerned  I  Anxiety  I 

distress,  distressed,  upset,  disturbed,  troubled  iDistressI 
fear,  fearful,  afraid,  frightened,  stressed  I  Fear  I 

guilt,  guilty  I  Guilt  I 

hope,  hopeful,  optimistic  I  Hope  I 

joy,  joyful,  exited,  happy  I  Joy  I 

In  order  to  detect  the  state  the  user  asks  about  (for  instance  boy-healthy), 
a  lookup  table  with  boolean  functions  is  used  (table  5.1).  In  order  to  make 
general  questions  like  “How  do  you  feel  about  the  boy?”  possible,  questions 
which  contain  only  one  keyword  will  be  directed  to  one  of  the  most  likely  states 
the  user  is  interested  in. 


5.3  Natural  language  generation 

The  agents’  answers  will  be  constructed  by  the  use  of  templates,  as  explained  in 
section  5.3.1.  The  information  needed  to  fill  in  the  templates  must  be  provided 
by  the  system;  this  is  explained  in  more  detail  in  section  5.3.2. 

5.3.1  Templates 

When  the  NLG  module  is  not  used  for  creating  sentences,  either  fixed  strings 
(canned  text  )  or  templates  are  alternatives.  Since  templates  are  more  flexible 
and  dynamical  [JurOO],  this  method  is  used  mainly  for  constructing  the  agents’ 
utterances. 

For  each  of  the  questions  mentioned  in  section  4.3  a  template  type  is  avail¬ 
able;  each  type  has  one  or  more  alternatives,  depending  for  instance  on  the 
terseness  of  the  agent.  The  template  types  are  listed  in  the  following  subsec¬ 
tions.  In  what  way  the  templates  are  filled  is  described  in  section  5.3.2. 

The  template  type  is  selected  in  Soar,  by  detecting  assertions  to  certain  types 
of  questions,  as  discussed  in  section  5.2.  Once  a  template  type  is  selected,  a  TCL 
script  will  be  called,  which  selects  and  fills  in  a  certain  alternative,  returning 
the  string  to  Soar. 

EM  is  defined  as  the  set  containing  the  emotions:  EM  =  {anger,  auixiety, 
distress, fear,  guilt, hope,  joy}. 

^One  can  argue  whether  we  are  just  lazy  not  implementing  a  clarification  system,  or 
whether  this  one-to-many  method  makes  the  agent  more  human-like.  We  tend  to  favor  the 
latter. 
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Natural  language 

Internal  representation 

crowd  A  goodwil 

maintain-goodwill 

crowd  A  anger 

crowd-angry 

(boy  V  child  V  kid)  A  dead 

boy-dead 

boy  V  child  V  kid 

boy-healthy 

(boy  V  child  V  kid)  A  minor  A  injuries 

minor-inj uries 

(boy  V  child  V  kid)  A  serious  A  injuries 

serious-in juries 

(boy  V  child  V  kid)  A  critical  A  injuries 

critical-inj uries 

driver 

driver-healthy 

driver  A  (injuries  V  injured) 

driver-minor-inj 

mom  V  mother  V  woman 

mother-healthy 

(boy  V  child  V  kid)  A  health  A  known 

know-boy-health 

(squads  V  sqds)  A  transit 

sqds-in-transit 

(lieutenant  V  It)  A  transit 

It-in-transit 

(lieutenant  V  It)  A  (aa  V  (assembly  A  area)) 

It-at-aa 

(lieutenant  V  It)  A  celic 

It-at-celic 

(sergeant  V  sgt)  A  (aa  V  (assembly  A  area)) 

sgt-at-aa 

medic  A  (aa  V  (assembly  A  area)) 

medic-at-aa 

(boy  V  child  V  kid)  A  (aa  V  assembly  A  area) 

at-boy-aa 

((1st  V  first)  A  (sqd  V  squad))  A  (aa  V  (assembly  A  area)) 

Ist-sqd-at-aa 

((1st  V  first)  A  (sqd  V  squad))  A  celic 

Ist-sqd-at-celic 

((1st  V  hrst)  A  (sqd  V  squad))  A  (Iz  V  (landing  A  zone)) 
same  for  2nd,  3rd  and  4th  squad 

Ist-sqd-at-lz 

((1st  V  first)  A  (sqd  V  squad))  A  transit 

Ist-sqd-in-transit 

((4th  V  fourth)  A  (sqd  V  squad))  A  transit 

4th-sqd-in-transit 

(boy  V  child  V  kid)  A  hospital 

at-boy-hospital 

(mom  V  mother  V  woman)  A  intersection 

mom-in-intersect 

(sqd  V  squad)  A  intersection 

sqd-in-intersect 

medevac  A  (aa  V  (assembly  A  area)) 

medevac-at-aa 

medevac  A  base 

medevac-at-base 

medevac 

medevac-called 

(medevac  A  overhead) 

medevac-overhead 

amb  A  (aa  V  (assembly  A  area) 

amb-at-aa 

amb  A  base 

amb-at-base 

amb 

ambulance-called 

route  A  (secure  V  secured) 

secure-route 

(aa  V  (assembly  A  area))  A  (secure  V  secured) 

aa-secure 

(accident  V  site)  A  (secure  V  secured) 

accident-secure 

(12  V  twelve)  A  (4  V  four)  A  (secure  V  secured) 

12-to-4-secure 

(4  V  four)  A  (8  V  eight)  A  (secure  V  secured) 

4-to-8-secure 

(8  V  eight)  A  (12  V  twelve)  A  (secure  V  secured) 

8-to-12-secure 

(Iz  V  (landing  A  zone))  A  (secure  V  secured) 

Iz-secure 

(Iz  V  (landing  A  zone))  A  (mark  V  marked) 

Iz-marked 

(Iz  V  (landing  A  zone))  A  (clear  V  clearedd  V  free) 

(((2  V  two)  A  (6  V  six))  V  unit  V  team) 

Iz-clear 

A  (support  V  supporting) 

support-1-6 

(((2  V  two)  A  (6  V  six))  V  unit  V  team)  A  together 
(((2  V  two)  A  (6  V  six))  V  unit  V  team) 

retain-mass 

A  (fracture  V  fractured  V  split) 

fracture-unit 

((1  V  one)  A  (6  V  six))  A  celic 

1-6-at-celic 

hospital  A  tuzla 

hospital-at-tuzla 

Table  5.1:  Synonyms  for  states 
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As  noted,  the  template  fillings  will  be  discussed  in  section  5.3.2. 

Emotion  type 

As  an  answer  to  the  question  how  one  feels,  i.e.  “How  do  you  feel?”,  four  tem¬ 
plate  alternatives  are  available.  What  emotion  emotion  is  returned  in  the  answer 
depends  on  the  intensity  of  the  emotions: 

emotion  G  EM,  Ve  G  EM  :  intensity f-motion  >  intensity^, 

The  first  template  alternative  is  in  effect  if  the  maximum  emotion  has  an 
intensity  small  enough  to  make  that  agent  belief  he  doesn’t  feel  it  (compare  with 
the  answer  to  “Do  you  feel  [emotion]?”).  If  the  intensity  is  high  enough,  the  cho¬ 
sen  template  alternative  depends  on  the  terseness  personality -intensity  terseness 
of  the  agent: 

1.  I’m  fine,  sir. 
intensity  emotion  Ci  0-2 

2.  I  feel  [emotion],  sir. 

intensity  emotion  >  t). 2  /\  personality -intensity  terseness  >  0.75 

3.  I  feel  [intensity]  [emotion],  sir. 

intensity  emotion  >  0.2  A  0.25  <  personality -intensity  terseness  <  0.75 

4.  I  feel  [intensity]  [emotion],  because  of  [state-pre]  [influence]  [status]  [state- 
post],  sir. 

intensity  emotion  >  t). 2  /\  personality -intensity  terseness  <  0.25 

To  the  question  how  one  feels  about  a  certain  state,  two  different  template 
alternatives  are  available.  Here,  too,  does  the  chosen  alternative  depend  on  the 
terseness  of  the  agent: 

1.  I  feel  [emotion]  about  it,  sir. 
personality -intensityterseness  >  0.5 

2.  I  feel  [intensity]  [emotion]  about  it,  sir. 
personality -intensityterseness  <  0.5 

The  third  question  was  about  confirmation  on  a  certain  emotion.  The  given 
answer  depends  on  the  intensity  of  the  emotion  asked  for  and  the  terseness  of 
the  agent: 

1.  Not  at  all,  sir. 

intensity  emotion  0.1 

2.  No,  sir. 

0.1  <  intensity  emotion  <0.2 

3.  I  don’t,  sir. 

0.1  <  intensity  emotion  <0.2 

4.  Yes,  sir. 

0.2  <  intensityemoUon  <  QA  /\  per sonality -intensity terseness  >  0.25 
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5.  I  do,  sir. 

0.2  <  intensity ernotion  <  0.5  A  personality  Jntensityterseness  >  0.25 

6.  Certainly,  sir. 

intensity  emotion  >  0.5  A  personality  intensity  terseness  >  0-25 

7.  I  do,  sir,  because  of  [state-pre]  [influence]  [status]  [state-post],  sir. 
intensity  emotion  >  0.2  A  personality  Sntensity  terseness  <  0.25 


Intensity 

In  contradiction  to  all  other  speech  acts,  the  speech  acts  concerning  the  intensity 
(“Calm  down.”)  do  not  have  a  question-answer  construction,  but  the  user  is 
trying  to  soothe  the  agent.  The  agent’s  reaction  depends  on  the  intensity  of  all 
emotions,  i.e.  for  every  emotion  the  intensity  needs  to  be  really  low  to  give  a 
negative  reaction: 

1.  Yes,  sir. 

demotion  G  EM  :  intemsity emotion  >  0.20 

2.  Will  do,  sir. 

demotion  G  EM  :  intensity  emotion  >  0.20 

3.  I  am  calm,  sir. 

'^emotion  G  EM  :  intensity  emotion  <  0.20 

4.  I  am  already  relaxed,  sir. 

'^emotion  G  EM  :  intensity  emotion  Y  0.20 


State 

The  reason  why  an  agent  feels  a  certain  way  has  already  been  discussed  before,  in 
the  most  expressive  version  of  the  question  “How  do  you  feel?” .  When  explicitly 
asked  for  the  reason  of  a  certain  feeling,  the  agent  may  either  answer  that 
question  by  naming  a  certain  state  or  rejecting  that  question,  depending  on  the 
intensity  of  the  emotion  emotion  asked  for. 

Note  that  it  is  only  possible  to  explicitly  blame  one  (“Your  fault!”)  if  some¬ 
one  is  actually  to  be  blamed  {blameworthiness  =  blameworthy). 

1.  I’m  not  feeling  [emotion],  sir. 

intensity  emotion  <0.20 

2.  That’s  personal,  sir. 

intensity  emotion  >  0.20  A  personality  Jntensitydefensivemss  >  0.75 

3.  Because  of  [state-pre]  [influence]  [status]  [state-post],  sir. 

intensity  emotion  >  0.20  A  (^3r  :  responsihle.agentemoUon  =  r  V  0.25  < 
per sonality -intensity clef  ensiveness  <  0 .15\J  {per sonality -intensity terseness 
0.75  A  {blameworthiness  =  praiseworthy  V  emotion  =  hopeV  emotion  = 

joy))) 
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4.  The  [state-pre]  [influence]  [status]  [state-post],  sir,  that’s  [responsible .agent _poss] 
fault! 

intensity  emotion  >  0.20  A  3r  :  responsibleMgentemoUon  =  r  A 

personality Sntensitydefensiveness  <  0.25Ablameworthiness  =  blamieworthyA 

-^{emotion  =  hope  V  emotion  =  joy) 

Responsible  agent  and  blameworthiness 

Although  the  question  “Who’s  responsible  for  [state]?”  can  be  a  logical  part  of 
an  emotion  dialogue,  it  does  not  directly  touch  on  the  subject  of  emotion.  For 
the  sake  of  time,  this  question  therefore  is  left  for  the  original  MRE  team  to 
implement. 

The  subject  of  the  responsible  agent  has  already  been  discussed  above,  but 
there’s  a  small  difference  in  the  answer  to  the  question  “Who’s  responsible  for 
making  you  feel  [emotion]?”.  The  agent  replies  by  naming  the  responsible  agent, 
which  makes  it  not  sound  to  use  the  same  template  fillings  as  in  the  section 
above,  because  a  pronoun  is  needed  instead  of  a  possessive  pronoun. 

It  depends  on  the  intensity  of  the  emotion  the  responsible  agent  is  involved 
in  whether  the  responsible  agent  is  mentioned  in  the  answer.  If  the  intensity  of 
the  emotion  is  less  than  the  threshold,  the  agent  does  not  actually  consider  the 
emotion,  so  he  replies  negatively. 

Since  not  all  states  have  to  have  a  responsible  agent,  if  the  intensity  is  greater 
than  the  threshold,  first  it  is  checked  if  the  responsible  agent  exists.  If  it  does 
not  exist,  the  agent  needs  to  reply  accordingly. 

1.  I’m  not  [emotion],  sir. 

intensity  emotion  <  0.20 

2.  I  don’t  know  who  is  responsible,  sir. 

intensity  emotion  >  0.20  A  —Ar  :  responsible.agentemoUon  =  r 

3.  [Responsible -agent],  sir. 

intensity  emotion  >  0.20  A  3r  :  responsiblemgentemotion  =  r  A 
{personality -intensity terseness  >  0.25\/blameworthiness  =  praiseworthyV 
emotion  =  hope  V  emotion  =  j  oy) 

4.  That’s  [responsible_agent_poss]  fault,  sir! 

intensity  emotion  >  0.20  A  3r  :  responsible-agentemoUon  =  r  A 

per sonality -intensity terseness  <  0.75Ablameworthiness  =  blameworthyA 

emotion  yf  hope  A  emotion  yf  j  oy) 

5.3.2  Pieces  of  objects 

To  be  able  to  All  in  the  templates,  the  information  provided  by  the  system  has 
to  be  converted  into  usable  pieces.  The  information  deducted  from  the  relevant 
objects  will  be  converted  to  natural  language  strings  and  stored  in  lookup  tables 
in  the  top  state.  In  this  subsection  all  the  values  for  the  different  attributes  are 
presented.  At  this  moment  only  one  possible  value  is  given.  Because  Soar  has 
the  possibility  of  randomly  picking  an  entry  if  more  attributes  with  the  same 
name  exist,  it  is  possible  to  increase  the  number  of  translations,  making  the 
answers  of  the  agents  more  diverse  and  enhancing  the  use  of  natural  language. 
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Emotions 


Emotion  Natural  language  string 


anger 

angry 

anxiety 

anxions 

distress 

distressed 

fear 

fearfnl 

guilt 

guilty 

hope 

hopefnl 

j°y 

joyful 

Table  5.2:  Values  for  the  nl-emotion  attribute 

The  individual  emotions  are  used  in  several  templates.  The  translation  to 
natural  language  for  the  most  important  emotion  is  stored  in  the  attribute 
"nl-emotion.  The  translations  are  listed  in  table  5.2. 

Intensity 


Intensity  i  Natural  language  string 


i  <  0.25 

a  little 

0.25  <i<  0.50 

pretty 

0.50  <i<  0.75 

really 

0.75  <i 

very 

Table  5.3:  Values  for  the  nl-intensity  attribute 

The  intensity  of  the  most  important  emotion  is  stored  in  the  attribute 
"nl-intensity  in  the  top  state.  Translations  are  in  table  5.3. 

State 

The  translation  of  the  states  to  natural  language  is  split  into  two  pieces,  namely 
"nl-state-pre  and  "nl-state-post.  This  is  necessary,  since  some  templates 
require  certain  words  to  be  inserted  between  these  two  parts,  like  the  verb  in  a 
sentence  and  optionally  a  negational  word  ( “not” ) .  Both  pieces  of  text  for  every 
status  are  listed  in  table  5.8  on  page  40. 

Since  it  is  only  possible  to  have  a  conversation  in  English  with  the  sergeant 
and  the  medic,  only  the  states  for  these  two  agents  are  transformed  to  natural 
language. 

Influence 


Influence  Natural  language  string 

facilitator  <nothing> 
inhabitor  not 


Table  5.4:  Values  for  the  nl-influence  attribute 
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The  type  attribute  of  an  appraisal  (table  5.4)  indicates  whether  the  event 
facilitates  (helps)  or  inhibits  (threatens)  the  appraised  state.  This  information 
is  used  to  express  if  the  emotion  is  about  progress  towards  or  the  blocking  of  a 
(un)desired  state.  In  the  second  case,  the  word  “not”  is  added,  see  table  5.4. 


Status 


Status  Natural  language  string 

confirmed  being 

unconfirmed  going  to  be 


Table  5.5:  Values  for  the  nl-status  attribute 


For  every  state,  the  attribute  status  annotates  whether  the  state  has  already 
happened  (confirmed)  or  if  it  not  yet  has  happened  (unconfirmed).  If  the  state 
has  not  yet  happened,  the  feelings  of  the  agent  are  about  the  future,  so  the  verb 
of  the  output  sentence  should  by  altered  to  future  tense  in  that  case,  as  shown 
in  table  5.5. 


Responsible  agent 


Responsible  agent  Natural  language  string 


Isldr 

The 

2sldr 

The 

3sldr 

The 

4sldr 

The 

ambulance 

The 

base 

The 

It 

You 

medevac 

The 

medicf 

The 

momf 

The 

sgtj 

The 

first  squad  leader  /  Johnson 

second  squad  leader 

third  squad  leader 

fourth  squad  leader  /  Lopez 

ambulance 

base 

are 

medevac 
medic  /  Tucci 
mother 
sergeant 


Table  5.6:  Values  for  the  nl-responsible_agent  attribute 

Every  state  has  a  certain  responsible  agent  and  it’s  possible  the  agent  wants 
to  express  this  information  in  his  utterance,  especially  when  he  feels  angry  about 
someone  messing  something  up.  Both  the  pronoun  nl-responsible_agent  and 
the  possessive  pronoun  nl-responsible_agent_poss  of  every  agent  are  needed 
(see  subsection  5.3.1).  The  different  values  for  the  responsible  agents  are  in 
table  5.6  and  table  5.7.  These  values  have  one  exception:  for  the  intelligent 
agents  in  the  system  (marked  with  a  f)  respectively  “my”  and  “I  am”  applies 
for  the  value  that  is  equal  to  themselves,  i.e.  for  the  sergeant,  the  value  of  sgt 
will  be  “my”  and  “I  am”  instead  of  “the  sergeant’s”  and  “The  sergeant”. 
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Responsible  agent  Natural  language  string 


Isldr 

first  squad  leader’s  /  Johnson’s 

2sldr 

second  squad  leader’s 

3sldr 

third  squad  leader’s 

4sldr 

fourth  squad  leader’s  /  Lopez’s 

ambulance 

the  ambulance’s 

base 

the  base’s 

It 

your 

medevac 

the  medevac’s 

medicf 

the  medic’s  /  Tucci’s 

momf 

the  mother’s 

sgtj 

the  sergeant’s 

Table  5.7:  Values  for  the  nl-responsible_agent_poss  attribute 


5.4  Overview 

An  overview  of  the  design  is  depicted  in  figure  5.1.  The  straight  path  (indicated 
by  bold  lines)  is  normally  taken  with  fully  implemented  questions  and  answers. 
We  will  bypass  both  the  NLU  module  and  part  of  the  NLG  module,  as  described 
earlier 


Figure  5.1:  Dataflow  user-agent  emotional  dialoge 


5.5  Iteration 

This  section  will  discuss  the  encountered  aspects  during  later  phases,  which  led 
to  changes  to  the  original  design. 
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State 

nl-state-pre 

nl-state-post 

maintain-goodwill 

the  goodwill  of  the  crowd 

maintained 

crowd-angry 

the  crowd 

angry 

boy-dead 

the  boy 

dead 

boy-healthy 

the  boy 

healthy 

minor-inj  uries 

the  boy 

slightly  injured 

serious-in juries 

the  boy 

seriously  injured 

critical-inj uries 

the  boy 

critically  injured 

driver-healthy 

the  driver 

healthy 

driver-minor-inj 

the  driver 

slightly  injured 

mom-healthy 

the  mother 

healthy 

know-boy-health 

the  health  of  the  boy 

known 

sqds-in-transit 

the  squads 

in  transit  to  the  assembly  area 

It-in-transit 

the  lieutenant 

in  transit  to  the  assembly  area 

It-at-aa 

the  lieutenant 

at  the  assembly  area 

It-at-celic 

the  lieutenant 

at  Celic 

sgt-at-aa 

the  sergeant 

at  the  assembly  area 

medic-at-aa 

the  medic 

at  the  assembly  area 

at-boy-aa 

the  boy 

at  the  assembly  area 

mom-at-aa 

the  mother 

at  the  assembly  area 

Ist-sqd-at-aa 

the  first  squad 

at  the  assembly  area 

Ist-sqd-at-celic 

the  first  squad 

at  Celic 

Ist-sqd-at-lz 

the  first  squad 

(same  for  2nd,  3rd  and  4th) 

at  the  landing  zone 

Ist-sqd-in-transit 

the  first  squad 

in  transit  to  the  assembly  area 

4th-sqd-in-transit 

the  fourth  squad 

in  transit  to  the  assembly  area 

at-boy-hospital 

the  boy 

at  the  hospital 

mom-in-intersect 

the  mother 

at  the  intersection 

sqd-in-intersect 

the  squad 

at  the  intersection 

medevac-at-aa 

the  medevac 

at  the  assembly  area 

medevac-at-base 

the  medevac 

at  the  base 

medevac-called 

the  medevac 

called  for 

medevac-overhead 

the  medevac 

overhead 

amb-at-aa 

the  ambulance 

at  the  assembly  area 

amb-at-base 

the  ambulance 

at  the  base 

ambulance-called 

the  ambulance 

called  for 

secure-route 

the  route  to  Celic 

secured 

aa-secure 

the  assembly  area 

secured 

accident-secure 

the  accident  site 

secured 

12-to-4-secure 

the  assembly  area 

partly  secured 

4-to-8-secure 

the  assembly  area 

partly  secured 

8-to-12-secure 

the  assembly  area 

partly  secured 

Iz-secure 

the  landing  zone 

secured 

Iz-marked 

the  landing  zone 

marked  by  green  smoke 

Iz-clear 

the  landing  zone 

cleared  of  civilians 

support-1-6 

our  team 

active  supporting  Eagle  2-6 

retain-mass 

our  team 

together 

fracture-unit 

our  team 

split  up 

1-6-at-celic 

our  team 

at  Celic 

hospital-at-tuzla 

the  hospital 

at  Tuzla 

Table  5.8:  Values  for  the  nl-state-pre  and  the  nl-state-post  attributes 
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5.5.1  Keyword  scanning 

As  noted  in  chapter  4.3,  certain  changes  were  made  to  the  speech  acts.  A  list  of 
speech  acts  which  were  implemented  can  be  found  in  appendix  A.  Some  of  these 
speech  acts  were  not  detected  properly  when  using  the  keywords  in  section  5.2. 
As  a  result,  different  keywords  are  used  in  the  actual  implementation  and  the 
absence  of  keywords  is  also  checked.  The  Soar  code  of  language-emia.  soar  in 
appendix  B  shows  the  implemented  keywords. 

During  the  design  we  weren’t  aware  of  the  fact  that  a  lexicon  already  existed. 
This  lexicon  already  contained  most  of  the  synonyms  needed,  so  it  was  extended 
with  some  additional  entries,  like  the  emotion  synonyms.  The  boolean  functions 
for  detecting  states  caused  some  problems,  as  these  are  hard  to  implement  in  a 
static  Soar  look-up  table.  This  will  be  discussed  in  section  6.3. 

During  the  implementation  it  became  clear  that  the  formal  semantics  didn’t 
lead  to  the  expected  results  if  the  type  attribute  within  the  properties  of  the 
semantics  wasn’t  set.  Also,  we  learned  that  although  not  really  necessary  for 
our  purposes,  it  is  good  practise  to  include  an  object-id.  Therefore  all  semantics 
were  extended  with  “type  state  and  “object  <self>. 

It  is  noted  that  the  use  of  the  state  attributes,  like  max-feeling,  as  the  value 
for  the  semantic  “attribute,  will  in  most  cases  restrict  the  matching  states  for 
answering  a  question  to  one.  A  more  sophisticated  mechanism  could  lead  to 
more  complicated  answers.  More  on  this  subject  in  the  next  chapter. 

5.5.2  Templates 

During  implementation,  it  became  clear  that  the  design  of  the  templates  did 
not  fulfill  our  demands  in  terms  of  how  natural  their  output  was.  Even  though 
they  looked  good  on  paper,  in  discussion  with  the  agents  the  sentences  seemed 
artificial.  To  enhance  the  quality  of  the  sentences,  the  following  changes  have 
been  made: 

1.  The  values  for  the  status  and  the  influence  attribute  are  linked  together 
to  choose  an  output  utterance,  instead  of  them  individually  selecting  tem¬ 
plate  fillings.  The  design  in  table  5.9  is  now  used,  instead  of  the  one  in 
tables  5.4  and  5.5. 

2.  The  templates  that  included  causality  have  been  modified:  the  part  of 
sentences  that  read  “. . .  because  of  [state-pre]  [influence]  [status]  [state- 
post]  ...”  have  been  changed  to  “. .  .because  [state-pre]  [influence-status] 
[state-post]  ...  ”,  [influence-status]  being  the  value  found  in  table  5.9. 


Influence 

facilitator 

inhabitor 

facilitator 

inhabitor 


Status 

confirmed 

confirmed 

unconfirmed 

unconfirmed 


Natural  language  string 

is 

is  not 

will  probably  be 
probably  won’t  be 


Table  5.9:  Values  for  the  nl-inf  luence-status  attribute 


Furthermore,  some  changes  were  made  in  the  way  an  utterance  is  exactly 
phrased.  For  instance,  the  agent  now  answers  a  question  about  the  boy  or  driver 
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with  “I’m  worried  about  him.”,  rather  than  “I’m  worried  about  it.”.  In  some 
cases  these  alterations  lead  to  incorrect  English,  but  we’ve  chosen  to  give  priority 
to  natural  and  correct  language  for  most  cases  and  small  discrepancies  for  others 
over  correct  but  innatural  language  for  all  cases.  All  types  of  speech  acts  can 
be  seen  in  appendix  A,  the  exact  implementation  can  be  seen  in  appendix  B. 


Chapter  6 


Implementation 


6.1  Introduction 

This  chapter  shows  how  the  design  in  the  last  chapter  was  implemented,  using 
Soar  and  TCL.  It  discusses  aspects  of  both  implementation  and  testing  which 
led  to  problems  or  certain  insights.  The  first  section  is  about  emotion  states. 
Natural  language  understanding  and  generation  will  be  discussed  in  subsequent 
sections.  All  the  Soar  and  TCL  code  can  be  found  in  appendix  B. 


6.2  Emotion  states 

The  emotion  state  max-feeling  is  created,  using  the  “max  attribute  of  the 
input-link,  which  can  be  found  in  io .  input-link  on  the  top  state.  The  seven 
feeling  states  are  created  by  taking  the  aggregate  intensity  out  of  the  input- 
link  and  letting  the  polarity  depend  on  this  intensity  and  the  designed  thresh¬ 
old.  For  every  responsible-f or- [emotion]  (e.g.  responsible-f or-anger 
and  responsible-f  or-hope)  an  individual  rule  is  implemented,  which  depends 
in  the  left-hand-side  on  the  existence  of  a  feeling  emotion  state  with  positive 
polarity:  if  the  agent  does  not  feel  a  certain  emotion,  there  cannot  be  a  re¬ 
sponsible  agent  for  that  emotion.  Finally,  the  on-the-fiy  f eeling-about-state 
emotion  state  is  elaborated  if  the  right  operator  is  in  effect  {output- speech) 
and  there  actually  exists  a  significant  appraisal  about  that  state  (significance 
is  implemented  by  a  small  threshold  on  the  intensity  of  an  appraisal).  If  one 
or  more  significant  appraisals  do  exist,  the  appraisal  with  the  highest  inten¬ 
sity  is  chosen  and  the  emotion  of  that  appraisal  is  taken  as  the  value  for  the 
f eeling-about-state  state. 

Causality  for  max-feeling  and  feeling  emotion  states  is  added  after  the 
elaboration  of  the  states.  For  every  emotion,  the  appraisal  objects  are  scanned 
for  the  object  with  the  highest  intensity.  A  link  to  the  appraisal  object  is  saved  in 
the  “source  attribute,  while  the  appraised  state  is  saved  in  the  cause  attribute. 

One  last  rule  adds  the  simulation  object  to  the  f eeling-about-state  emo¬ 
tion  state.  A  simulation  object  is  the  name  of  one  of  the  objects  in  the  virtual 
world,  which  for  example  can  be  used  to  have  agents  gaze  at  that  object.  Unfor¬ 
tunately,  the  names  of  these  object  do  not  equal  the  names  in  the  Soar  system, 
so  they  have  to  be  added  explicitly. 
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6.3  Natural  language  understanding 

The  basis  of  the  natural  language  understanding  part  is  formed  by  a  type  of  Soar 
rule  that  maps  a  certain  question  related  to  emotions  to  the  right  semantics. 
For  the  left-hand  side  of  this  rule,  two  things  are  important.  First,  how  to 
detect  the  right  sentences,  and  second,  how  to  map  natural  language  to  the  the 
formal  representation  of  emotions  and  states.  For  detecting  the  right  sentences, 
keywords  are  used  as  described  in  section  5.2.  In  order  to  avoid  ambiguity  we 
use  both  words  that  must  be  present  and  those  that  must  be  absent.  This  makes 
it  possible  to  distinct  between  “How  do  you  feel?”  and  “How  do  you  feel  about 
[state]?”  when  the  question  “How  do  you  feel  about  the  boy  being  injured?”  is 
uttered. 

For  mapping  natural  language  to  the  formal  representation  both  the  existing 
lexicon  and  new  code  is  used.  The  lexicon  is  expanded  with  emotions  so,  for 
instance,  both  “angry”  and  “anger”  are  mapped  to  the  internal  representation 
I  Anger  I .  The  implementation  of  state  detection  caused  a  bit  of  a  problem,  as 
boolean  functions  like  in  table  5.8  are  hard  to  represent  in  a  static  Soar  structure. 
A  Soar  rule  for  every  state  would  be  a  solution,  mapping  certain  words  directly 
to  the  appropiate  state,  but  this  is  of  course  very  labour  extensive,  hard  to 
maintain  and  also  not  very  neat.  The  existing  lexicon  is  therefore  extended  with 
a  list  of  all  the  states  and  all  the  words  which  map  to  a  certain  state.  Figure  6.2 
shows  part  of  this  list.  The  problem  now  is  that  one  single  word  already  leads 
to  a  state  and  in  cases  like  “boy”  to  multiple  states.  Therefore  three  Soar  rules 
were  made,  which  would  scan  for  either  one,  two  or  three  keywords  which  could 
lead  to  a  state.  When  all  posibilities  are  found,  a  Soar  rule  will  select  the  one 
with  the  highest  priority,  i.e.  the  most  keywords  (the  most  detailed  description). 
The  selection  of  which  keywords  are  needed  for  a  certain  state  is  now  somewhat 
restricted,  as  in  no  situation  a  lower  priority  match  is  to  be  better  than  than  a 
higher  priority  match.  Originally,  when  more  than  one  candidate  with  the  same 
priority  was  present,  the  system  would  randomly  choose  one.  During  testing 
it  was  noticed,  that  this  often  resulted  in  unnatural  situations  where  the  agent 
dismissed  the  question  as  not  being  important,  while  it  deary  was.  This  is 
particulary  true  for  the  question  “How  do  you  feel  about  the  boy?”  which  leads 
to  eight  possible  states,  of  which  only  two  are  relevant.  Now,  all  the  states  that 
don’t  lead  to  an  emotion  with  a  certain  intensity  are  discarded  and  a  random 
choice  between  all  remaining  candidates  is  made.  The  randomization  should 
make  conversation  more  dynamic,  as  opposed  to  always  selecting  the  one  with 
the  highest  assiociated  emotion.  As  there  is  already  a  threshold  implemented 
for  linking  emotions  to  states,  these  random  answers  should  be  sensible.  It  is 
noted  that  this  selection  mechanism  is  performed  on  the  understanding  side, 
rather  than  the  generation  side.  More  about  this  at  the  end  of  this  section. 

As  Soar  computes  all  possibilities  of  how  certain  keywords  lead  to  states,  it 
can  be  rather  processor  intensive.  When  a  question  contains  three  keywords, 
for  instance,  it  not  only  finds  the  states  which  can  be  reached  with  these  three 
words,  but  also  all  possiblities  of  how  to  reach  states  with  one  and  two  words. 
For  now  the  impact  doesn’t  seem  to  be  too  big,  but  if  it  turns  out  that  these 
rules  take  relatively  too  much  processor  time,  one  could  alter  the  mechanism  a 
bit  by  putting  a  counter  on  the  top  state  which  holds  track  of  the  number  of 
keywords  needed  in  order  to  find  the  right  state.  It  can  be  set  to  three  at  first 
in  order  to  find  all  states  for  three  found  keywords.  If  no  results  show,  it  will 
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be  set  to  two,  so  all  results  with  two  keywords  can  be  found.  This  will  ensure 
that  no  time  is  wasted  on  finding  states  with  a  lower  priority  then  necessary. 

The  right-hand  side  of  the  basic  Soar  rule  is  a  rather  straight  forward  im¬ 
plementation  of  the  design  given  in  section  5.2,  with  a  few  exceptions.  First  of 
all,  a  priority  attribute  and  an  attribute  emotion-semantics  were  added.  This 
provides  an  opportunity  to  gather  all  possible  semantics  for  the  emotion  ques¬ 
tion  and  select  an  appropiate  one.  After  that,  the  emotion  semantics  is  given  a 
higher  preference  than  the  semantics  found  by  the  NLU,  as  this  for  now  delivers 
only  garbage.  In  order  to  get  the  right  state  name  when  asking  about  respon- 
siblity  (for  instance  responsible-f  or-anger)  a  TCL  rule  is  used,  as  Soar  isn’t 
particularly  good  with  strings. 

sp  {top-state*apply*operator*understand-speech*nlu=i'how-do-you-f eel-about-state*two 
(state  <s>  “name  top-state 
“operator  <o> 

“lexicon  <lexicon>) 

(<o>  “name  understand-speech 
“speech-input  <si>) 

(<si>  “interpretation  <i>) 

(<i>  “token. lex  <<  feel  feeling  think  » 

“token. lex  <<  about  of  » 

“token. lex  <wordl> 

“token. lex  {<word2>  <>  <wordl>}) 

(<lexicon>  “{<domainl>  <>  states  <>  emotion-responsibility-states} . <word-intl>  <wordl> 
“{<domain2>  <>  states  <>  emotion-responsibility-states} . <word-int2>  <word2> 
“states . <state>  <word-intl> 

“states . <state>  <word-int2>) 

— > 

(<i>  “mood  question 

“emotion-semantics  <sem>  +  &  ) 

(<sem>  “type  question 
“q-slot  value 
“priority  2 
“prop  <seml>) 

(<seml>  “attribute  f eeling-about-state 
“cause  <state> 

“type  state)} 


Figure  6.1:  Soar  rule  which  maps  the  utterance  “How  do  you  feel  about  [state]?” 
to  the  proper  semantics 

The  original  lexicon  is  divided  into  different  types  of  entries,  like  attributes, 
values  and  actions.  This  is  extended  with  states,  emotions,  emotion- 
responsiblity-states  and  misc.  Part  of  the  extension  of  the  lexicon  can 
be  seen  in  figure  6.2.  Of  particular  interest  is  the  states  entry.  Every  state 
is  followed  by  all  the  words  which  define  the  state.  Unfortunately,  not  all  the 
naming  conventions  are  consistent  within  MRE,  so  some  percularities  do  arise. 
The  phrase  minor-injuries,  for  instance,  is  used  both  as  a  value  and  a  state. 
The  original  lexicon  maps  several  words  to  the  value  minor-injuries,  which 
in  our  code  is  then  used  to  detect  the  state  minor-injuries.  Furthermore,  the 
same  word  can  lead  to  different  synonyms  (for  instance  the  word  “secure”  can 
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lead  to  the  attribute  safety,  the  value  secure  and  the  action  secure).  This 
can  lead  to  variation  in  state  detection,  as  no  further  criteria  for  selecting  a 
particular  synonym  is  used.  Excluding  the  actions  entry  in  the  search  is  a  first 
step  in  resolving  such  ambiguities,  but  it  is  noted  that  additional  mechanisms 
might  be  needed  when  extending  the  lexicon. 

sp  {top-state*elaborate*state*add-lexicon-entries*emotions 
(state  <s>  “name  top-state 

“agent-name  «  sgt  medic  director  » 

“lexicon  <lexicon>) 

— > 

(<lexicon>  “states  <states> 

“emotions  <emotions> 

“emotion-responsibility-states  <emotion-responsibility-states> 

“misc  <misc>) 

(<states>  “maintain-goodwill  crowd  +  &,  goodwill  +  & 

“crowd-angry  crowd  +  ft,  I  Anger  I  +  & 

“boy-dead  boy  +  & ,  dead  +  & 

“boy-healthy  boy  +  &,  healthy  +  & 

“minor-injuries  minor-injuries  +  &,  injuries  +  &,  boy  +  & 
“serious-injuries  serious-injuries  +  &,  injuries  +  &,  boy  +  & 
“critical-injuries  critical-injuries  +  &,  injuries  +  &,  boy  +  & 
“driver-healthy  driver  +  &,  healthy  +  & 

“driver-minor-inj  driver  +  &,  minor-injuries  +  &,  injuries  +  & 
“mother-healthy  mom  +  &,  healthy  +  & 

“know-boy-health  boy  +  &,  healthy  +  &,  known  +  & 
“sqds-in-transit  squads  +  &,  transit  +  & 

“It-in-transit  It  +  &,  transit  +  & 

“It-at-aa  It  +  &,  aa  +  & 

“It-at-celic  It  +  &,  celic  +  & 

)} 


Figure  6.2:  Soar  rule  which  extends  the  lexicon  with  states 

An  issue  already  briefly  pointed  out  in  subsection  5.5.1  is  the  fact  that  the 
emotion  code  is  rather  restrictive  on  the  understanding  side.  All  current  se¬ 
mantics  take  the  emotion  state  attribute,  like  max-feeling,  as  the  attribute 
value.  This  will  in  most  cases  result  in  only  one  matching  emotion  state  (refer¬ 
ence)  for  answering  a  question  later  on  in  the  generation  side,  as  described  in 
subsection  4.4.2.  In  other  words,  selecting  the  state  to  use  for  an  appropiate 
answer  to  a  certain  question  is  now  done  within  the  language  understanding 
side,  as  opposed  to  the  generation  side.  Future  work  could  be  focused  on  a 
more  sophisticated  answering  mechanism,  closer  to  the  ones  now  used  within 
MRE.  One  could  think  of  losing  the  max-feeling  state  and  when  receiving 
the  question  “How  do  you  feel?”  creating  semantics  like  “attribute  feeling 
“object-id  <self>  “q-slot  value.  This  will  result  in  the  generation  of  a  set 
of  references  to  all  the  feeling  states,  after  which  a  complicated  answer  like 
“I’m  feeling  both  worried  and  hopeful  about  the  boy”  is  possible.  One  could 
also  use  intermediate  attributes.  An  example  of  how  this  is  done,  is  the  use  of 
the  attribute  health-status,  which  is  mapped  to  all  possible  states  concern¬ 
ing  health,  like  boy-dead  or  driver-minor-inj.  Due  to  lack  of  time,  it  was 
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not  possible  to  make  fully  use  of  referencing.  The  current  implementation  does 
contain  the  foundations  for  further  work,  though.  Note  that  state  referencing 
can  also  be  used  for  making  references  within  a  conversation,  like  asking  “How 
do  you  feel  about  him?” . 

An  example  of  a  keyword  mapping  Soar  rule  can  be  found  in  figure  6.1.  The 
rule  searches  for  a  couple  of  words  used  in  asking  a  question  like  “How  do  you  feel 
about  [state]?”  and  two  words  which  could  lead  to  a  state.  These  two  words  are 
mapped  to  the  internal  representation  word-int,  so  for  instance  “kid”  becomes 
boy.  The  two  standardized  words  together  lead  to  a  certain  state,  for  instance 
boy  and  healthy  lead  to  the  state  boy-healthy.  Initially,  all  entries  were 
searched,  which  lead  to  problems  during  testing.  Therefore,  next  to  the  already 
mentioned  actions  entry,  the  state  and  emotion-responsibility-states 
entries  are  excluded  from  the  search,  as  these  are  ment  for  a  final  rather  than 
intermediate  result.  All  possibilities  are  added  as  an  emotion-semEintics  at¬ 
tribute  to  the  interpretation  attribute.  Certain  Soar  rules  will  select  one 
emotion-semantics  as  the  semantics  that  will  continue  the  rest  of  the  flow 
within  the  system. 


6.4  Natural  language  generation 

For  the  natural  language  generation  part  both  Soar  and  TCL  are  used.  The 
Soar  rules  detect  the  agent’s  intention  to  utter  something  and  the  particular 
rule  that  fires  will  gather  all  the  necessary  information  needed  to  generate  an 
output.  This  information  is  given  to  a  TCL  script  which  returns  the  utterance. 

The  left-hand  side  of  a  Soar  rule  first  tries  to  detect  a  certain  intention  to  say 
something.  When  implementation  started  the  comgoal  within  the  output-speech 
operator  was  used,  but  it  turned  out  that  it’s  structure  would  change,  according 
to  whether  the  agent  would  want  to  make  an  assertion  or  an  answer.  Conse¬ 
quently,  the  goal  attribute  is  used  instead.  Recall  from  subsection  4.4.2  that 
the  goal  can  be  seen  as  the  “why”  and  the  communicative  goal  as  that  “what” 
in  answering  a  question.  Early  during  the  implementation  phase  the  decision  of 
which  emotion  state  to  use  was  made  by  looking  at  the  semantics  of  the  original 
question,  stored  in  goal.  Later,  it  was  learned  that  existing  mechanisms  within 
the  MRE  system  automatically  generate  reference  states  for  every  state  that 
can  be  used  to  answer  the  question  (with  the  exception  of  questions  for  which 
on  the  fly  states  are  used).  These  references  are  now  used,  but  as  explained  in 
section  6.3  the  mechanism  is  not  used  to  it’s  full  potentional. 

Depending  on  the  type  of  question  and  answer,  certain  information  is  needed 
in  order  to  construct  that  answer.  There  are  several  places  from  where  that 
information  is  gathered.  All  natural  language  is  found  in  the  look-up  table 
emia-template-f  illing.  The  different  strings  of  language  are  stored  in  at¬ 
tributes  per  category,  as  described  in  section  5.3.2.  For  the  intensity,  both  the 
lower  and  the  upper  bound  are  stored,  making  it  possible  for  other  code  to  check 
on  both.  The  agent-dependent  template  fillings  for  the  responsible  agent  are 
added  in  seperate  rules,  because  the  agent’s  name  has  to  be  checked  here.  For 
the  selection  of  the  right  words,  information  from  the  emotion  and  regular  states 
is  used.  Personality  information  is  taken  from  io .  input-link.  In  the  case  a 
cause  or  responsible  agent  could  be  either  present  or  absent,  all  possibilities 
are  checked  and  the  one  with  the  highest  information  value  receives  the  highest 
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priority. 

The  right-hand  side  produces  a  surface  attribute  which  holds  the  answer  as 
a  value.  An  existing  process  will  make  sure  this  surface  value  will  be  spoken  by 
the  agent.  In  order  to  differentiate  between  certain  surfaces,  a  priority  system 
is  used  in  some  cases.  This  makes  it  possible  to  select  a  surface,  before  giving 
it  a  certain  Soar  preference.  This  priority  system  was  introduced,  because  the 
why-questions  originally  interfered  with  the  existing  MRE  code. 

The  value  for  the  surface  is  generated  by  a  template  in  TCL.  All  the  nec¬ 
essary  information  is  provided  by  Soar  to  TCL  as  parameters.  Based  on  these 
parameters  it  selects  a  certain  template  alternative,  as  discussed  in  section  5.3.1. 
During  implementation  it  was  decided  that  the  answer  would  be  deterministic 
for  the  sake  of  time. 


Chapter  7 


Testing 


7.1  Introduction 

This  chapter  describes  the  testing  phase  of  the  assignment.  The  combined  unit 
and  integrations  tests  can  be  found  in  section  7.2.  User  tests  will  be  discussed  in 
section  7.3.  These  sections  will  only  discuss  how  the  tests  were  being  performed 
and  what  the  results  are.  All  the  test  plans  can  be  found  in  appendix  C. 


7.2  Unit  and  integration  tests 

7.2.1  Method 

Unit  testing  is  about  testing  the  smallest  unit  of  the  software,  in  this  case  the 
Soar  rule.  Integration  testing  tests  if  the  implemented  software  works  correctly 
together.  These  tests  are  combined,  because  the  smallest  testable  unit  is  the 
Soar  rule,  but  certain  rules  depend  on  other  rules. 

The  tests  executed  are  white-box,  in  a  sense  that  every  Soar  rule  is  added 
individually  and  is  checked  for  it’s  results  by  looking  at  the  created  WME’s  in 
the  Soar  system.  For  integration  testing  the  use-based  testing  method  is  used: 
in  the  first  phase  the  Soar  rules  that  do  not  depend  on  other  rules  {independent 
rules)  but  the  original  code  are  tested.  The  rules  tested  in  the  second  phase 
only  depend  on  rules  in  the  first  phase,  rules  tested  in  the  third  phase  depend 
on  rules  in  the  first  two  phases,  and  so  forth.  The  rules  in  Phase  5  produce 
the  final  output  and  will  therefore  be  tested  as  a  black-box,  i.e.  we  look  at  the 
actual  outcome,  rather  than  any  internal  values.  The  testing  environment  is  the 
initialized  agent  for  the  sergeant  character  (vital  information,  for  some  code  is 
agent-dependant).  The  original  MRE  code  is  assumed  correct. 

7.2.2  Results 

The  tests  resulted  in  a  couple  of  issues.  For  minor  ones  like  spelling  errors  within 
templates  we  point  to  the  appendix.  Others  will  be  discussed  here. 

In  general,  it  showed  that  the  emotion  code  is  often  in  battle  with  the  existing 
code,  as  the  NLU  cannot  dynamically  be  shut  down.  A  rule  was  added  which 
states  that  if  there  are  more  speech  acts,  the  one  generated  by  the  emotion  code 
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is  preferred.  Furthermore,  our  “Why  do  you  feel  [emotion]?”  question  interfered 
with  the  generic  why-question,  causing  unexpected  answers.  This  was  due  to 
the  fact  that  for  this  particular  question  three  Soar  rules  existed,  all  with  a 
different  preference.  When  the  rule  with  the  lowest  preference  was  selected  as 
a  candidate  by  the  system,  it  was  always  competing  with  existing  rules  which 
also  had  the  lowest  preference.  In  order  to  avoid  these  situations,  priorities 
for  surfaces  were  introduced  which  will  first  select  the  appropiate  emotion  rule, 
after  which  the  selected  rule  receives  a  preference  high  enough  not  to  interfere 
with  existing  rules. 

The  use  of  the  existing  follow-up  why-question  led  to  some  problems  too. 
Most  of  the  time,  a  proper  answer  wouldn’t  come  up  and  if  it  did,  it  was  always 
constructed  in  the  present  tense,  even  if  the  state  was  to  happen  in  the  future. 
The  first  issue  was  due  the  way  the  code  behind  the  why-question  was  getting 
the  proper  information  and,  again,  the  fact  that  two  process  race  each  other. 
The  system  would  copy  information  neede  for  answering  the  why-question  as 
soon  as  it  was  ready,  not  noticing  that  that  information  could  be  rewritten  by 
another  process  later  on.  This  will  be  taken  care  of  by  the  MRE  team,  and 
should  also  fix  a  small  bug  where  the  agent  sometimes  utters  “nothing”  next 
to  the  answer  about  a  world  state.  The  tense  issue  required  some  work  in  the 
NLG  module  by  the  MRE  team,  and  an  additional  Soar  in  the  emotion  code 
setting  a  time  attribute  to  future  where  necessary.  It  is  noted  that  the  follow-up 
why-question  cannot  be  used  in  combination  with  the  on-the-fly  states. 

A  problem  with  the  feeling  and  max-feeling  emotion  states  arose  when 
more  sources  with  equal  intensity  were  available.  To  repair  the  fact  that  the 
source  object  associated  with  the  causality  (cause)  was  not  properly  created, 
an  extra  Soar  rule  has  been  added.  The  rule  creates  only  the  source  attribute 
for  an  emotion  state,  picking  one  randomly  if  more  options  are  available.  The 
original  rule  has  been  altered  so  that  if  a  source  attribute  exists,  this  object  is 
used  to  add  the  cause  attribute. 

State  detection  didn’t  always  go  according  to  plan.  This  is  due  to  how  the 
original  lexicon  was  set  up,  namely  diveded  into  various  entries.  As  several  en¬ 
tries  must  be  used  by  the  emotion  code  in  order  to  find  the  necessary  synonyms, 
the  code  scans  all  the  entries  in  the  lexicon.  By  adding  a  specific  states  entry, 
this  too  is  included  in  the  search  and  so  “boy”  can  lead  to  “minor-injuries”  and 
from  there  either  to  the  state  minor-injuries  or  driver-minor-inj .  To  avoid 
these  situations  these  rules  has  been  changed,  so  it  will  exclude  the  states 
entry.  Also,  the  emotion-responsibility-states  and  actions  entries  are  ex¬ 
cluded  as  these  led  to  conflicts  and  ambiguities  when  using  emotions  for  state 
detection. 

Two  bugs  remain  unsolved.  The  first  one  is  that  when  emotion  states  are 
being  updated  during  answering  an  emotion  question,  the  agent  won’t  be  able 
to  answer  properly.  This  is  due  to  the  design  of  how  the  emotion  states  are 
created  in  combination  with  the  use  of  references.  When  a  question  is  received, 
references  to  states  are  produced,  which  will  be  used  later  on  in  the  generation 
side.  In  the  time  between  creating  the  references  and  using  them,  the  states 
can  be  recreated,  though,  in  order  to  match  a  new  situation.  This  results  in 
invalid  references.  In  order  to  adress  this  problem,  the  emotion  states  should  be 
created  only  once  (0-support)  and  be  updated  by  additional  rules  (I-support). 
A  second  problem  arises  as  a  result  of  a  bug  within  the  original  MRE  code. 
It  came  to  light  that  the  Terseness  attribute  isn’t  always  present,  due  to  an 
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impasse  during  initialization.  As  this  attribute  is  needed  for  determining  the 
template  alternative,  it’s  absence  will  cause  the  agent  to  fail  generating  a  proper 
answer.  The  impasse  is  rare,  though,  and  is  beyond  our  abilities  to  fix. 


7.3  User  tests 

For  now,  the  emotion  dialogue  isn’t  meant  for  real  use  by  army  cadets,  but 
rather  as  a  feature  for  demonstrating  the  underlying  emotional  model  of  the 
agents.  We  therefore  handled  the  user  test  quite  informally.  A  user  was  given 
the  possibility  to  ’play’  with  the  system.  We  would  observe  the  user,  on  what 
questions  he  asked,  which  phrasing  he  used  and  whether  he  found  the  answers 
sufficient  and  natural.  Afterwards,  our  observations  were  discussed  with  the 
user.  A  total  of  three  users  participated  in  a  user  test. 

7.3.1  User  1 

During  the  first  user  test  a  couple  of  things  came  to  light.  Firt  of  all,  the  user 
asked  a  couple  of  questions  which  weren’t  covered  by  our  code.  These  can  be 
split  up  in  questions  which  we  do  cover  but  use  different  phrasing  for: 

•  How  is  it  going? 

•  What’s  on  your  mind? 

•  How  are  you  feeling? 

•  Who  are  you  mad  at? 

•  What  are  you  worried  about? 

and  sentences  which  semantics  aren’t  covered: 

•  You  don’t  look  calm. 

•  Why  are  you  mad  at  the  mother? 

•  Why  else?  (follow  up  question) 

•  Are  you  feeling  OK? 

•  Are  you  feeling  bad? 

We  decided  to  implement  the  first  type,  as  this  would  enhance  the  usability 
and  required  little  effort.  The  second  type  of  question  would  either  require 
new  states  or  advanced  use  of  references.  For  instance,  the  last  two  questions 
would  require  designing  a  state  dividing  all  emotions  in  good  and  bad  ones.  The 
second  question  requires  states  concerning  emotions  towards  other  agents.  As 
these  type  of  questions  weren’t  covered  in  the  initial  analysis  and  design  and 
would  take  quite  some  effort  to  implement  and  test,  we  decided  not  to  implement 
these  type  of  questions. 

After  this  user  test  we  mapped  the  word  “sad”  to  Distress  and  “mad”  to 
anger. 
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7.3.2  User  2 

Most  issues  in  the  first  user  test  were  addressed  for  our  second  user  test.  Again 
the  fact  that  references  to  earlier  conversation  parts  are  not  possible  was  re¬ 
marked.  Furthermore,  it  became  apparent  that  users  can  ask  question  negation 
wise,  as  in  “Why  are  you  not  afraid?”  We  will  save  this  type  of  questions  for 
further  research. 

7.3.3  User  3 

Again,  the  lack  of  context  was  noted.  The  user,  not  familiar  with  the  MRE 
system,  furthermore  expected  the  emotions  to  be  associated  directly  to  certain 
personas  rather  than  to  states  associated  with  personas.  This,  of  course,  is 
something  dictated  by  the  original  MRE  system,  but  could  be  an  interesting 
point  of  discussion.  As  in  the  first  user  test,  some  types  of  questions  were  asked 
which  are  not  covered,  like  “Why  does  the  medic  make  you  hopeful?” ,  “Are  you 
anxious  about  the  boy?”  and  “Does  the  medic  bring  joy?” .  Again,  we  leave 
these  for  further  research.  Finally,  the  synonym  “scared”  was  used  and  has  been 
added  to  the  lexicon. 


Chapter  8 

Conclusion 


Recall  from  chapter  3  that  the  goal  of  this  assignment  was  to  make  a  scenario- 
independent  implementation  of  an  emotion  dialogue,  where  agents  can: 

•  understand  user’s  utterances  concerning  emotions; 

•  use  existing  knowledge  of  their  emotional  state  to  express  themselves;  and 

•  express  themselves  using  natural  language. 

These  requirements  were  met:  a  user  can  ask  a  range  of  emotion  related  ques¬ 
tions  and  receive  answers  to  these  questions,  all  in  natural  language.  During 
the  implementation,  various  limitations  were  encountered,  creating  opportuni¬ 
ties  for  further  research  and  fine-tuning  -  these  recommendation  can  be  found 
in  chapter  9.  This  chapter  concludes  the  assignment  by  looking  at  the  different 
segments  of  the  final  implementation. 

Knowledge  about  the  emotions  is  made  available  by  creating  emotion  states. 
The  information  needed  for  the  analyzed  questions  are  filtered  out  of  the  existing 
appraisals  and  structured  into  states  with  a  conventional  structure;  the  creation 
is  scenario-independent.  The  translations  of  this  information  into  strings  of 
natural  language  is  stored  in  look-up  tables. 

By  preparing  the  necessary  information  in  this  way,  some  information  is  lost. 
For  instance,  the  emotion  state  for  a  feeling,  say  Distress,  only  has  the  state 
it  is  most  distressed  about  as  a  cause;  all  states  an  agent  feels  less  distressed 
about  are  ignored.  This  can  lead  to  odd  conversations  like: 

“How  do  you  feel  about  the  driver?” 

-“Fm  worried  about  him,  sir.” 

“Why  are  you  worried?” 

-“Fm  worried,  because  the  boy  has  critical  injuries.” 

Because  of  limitations  of  the  original  natural  language  understanding  mod¬ 
ule,  a  new  design  involving  keywords  has  been  implemented.  The  number  of 
keywords  per  question  was  kept  at  a  minimum  to  be  as  little  restrictive  as 
possible.  After  scanning,  the  most  complete  mapping  is  translated  into  seman¬ 
tics  compliant  to  the  system’s  conventions.  In  this  way,  the  emotion  code  still 
utilizes  the  available  language  reasoning  model. 
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A  limitation  using  keywords  is  the  fact  that  subtleties  are  hard  to  detect. 
For  instance,  negation-wise  questions  like  “Why  are  you  not  happy?”  would 
require  to  duplicate  all  existing  rules.  In  addition,  in  order  to  be  deterministic 
in  detecting  the  correct  questions,  the  number  of  keyword  increases  rapidly  when 
increasing  the  number  of  questions. 

For  the  language  generation  a  system  using  templates  has  been  designed, 
since  the  original  NLG  was  too  domain-specific  to  use.  The  choice  of  templates 
depends  on  various  variables  supplied  by  the  agent.  The  templates  are  filled 
with  the  strings  of  natural  language  in  the  look-up  tables  mentioned  earlier. 

Unfortunately,  a  system  using  templates  is  very  domain-specific,  too.  In 
order  to  provide  the  agent  with  the  ability  to  utter  various  types  of  utterances 
in  a  natural  way,  a  lot  of  templates  are  needed.  We’ve  chosen  to  give  priority  to 
natural  and  correct  language  for  most  cases  and  small  discrepancies  for  others 
over  correct  but  innatural  language  for  all  cases. 

In  order  to  use  keyword  scanning  and  templates  in  other  scenario’s  a  little 
effort  is  required.  On  the  understanding  side  the  new  states  must  be  made 
known,  i.e.  for  every  state  certain  keywords  that  detect  that  state  must  be 
given.  For  generating  language  concerning  these  new  states,  verbal  references 
must  be  made  known,  i.e.  for  every  state  some  strings  of  natural  language  must 
be  given  to  use  when  referring  to  a  certain  state  in  an  utterance. 

During  the  assignment,  some  interesting  points  concerning  emotion  dialogue 
came  to  attention.  A  discussion  was  started  about  how  to  blend  emotion  di¬ 
alogue  naturally  into  existing  dialogue.  This  discussion  can  be  split  into  two 
main  topics: 

•  How  do  humans  in  general  use  emotions  in  conversations? 

•  If  and  in  what  way  is  emotion  dialogue  used  within  an  army  environment? 

The  first  question  leads  to  aspects  like  the  relation  one  has  with  its  conver¬ 
sational  partner,  one’s  personality  and  one’s  coping  strategies  used.  One  could 
think  of  using  emotions  as  a  threshold  to  bring  up  certain  conversational  topics 
or  using  coping  strategies  for  selecting  an  answer;  denial,  for  instance,  might 
then  trigger  a  factual  false,  but  emotional  true  answer.  As  for  the  use  of  emo¬ 
tion  dialogue  in  the  army,  one  could  think  of  debriefing  situations,  or  media 
training. 

A  major  part  in  integrating  emotion  utterances  in  the  dialogue  is  to  make 
use  of  the  dialogue  context,  like  asking  “How  do  you  feel  about  that?”.  The 
reference  system  should  be  fully  implemented  for  this. 

A  point  of  interest  too,  can  be  appraising  emotion  states.  That  would  result 
in  the  agent  being  aware  of  his  own  emotions  and  react  accordingly.  Currently, 
the  emotion  code  does  alter  the  emotion  intensity  somewhat,  but  not  much 
attention  has  been  given  to  this  aspect. 

All  in  all,  a  lot  of  work  remains  to  be  done.  Still,  this  assignment  was  worth¬ 
while.  The  current  result  can  be  used  for  demonstrating  the  agent’s  emotions 
in  a  natural  way  and  can,  with  a  little  effort,  be  extended  to  other  scenarios. 
Also,  it  resulted  in  valuable  insights  for  further  work,  of  which  an  overview  can 
be  seen  in  the  next  chapter. 


Chapter  9 

Recommendat  ions 


A  couple  of  aspects  can  be  pointed  out  for  future  work: 

Make  full  use  of  references.  References  are  used  to  gather  all  states  which 
could  be  used  for  answering  a  question.  A  decision  mechanism  then  uses 
these  states  to  come  up  with  an  aswer  by,  for  instance,  using  one  or  more 
states  information  sources,  or  by  deciding  more  information  is  needed  in 
order  to  answer  the  question  correctly.  References  can  be  used  to  create 
context  ( “How  do  you  feel  about  him?”  will  come  up  with  all  the  possible 
references  for  “him” )  and  to  create  more  sophisticated  answers  ( “How  do 
you  feel?”  will  come  up  with  all  the  matching  feelings  after  which  one 
or  combination  of  these  can  be  selected).  In  the  original  MRE  system 
references  are  used  for  a  couple  of  different  types,  like  states  and  events. 
Using  it  for  emotions  would  require  designing  and  implementing  a  new 
type.  Also,  it  would  require  to  redesign  and  extend  the  number  of  emotion 
states  in  order  to  have  a  larger  set  for  references. 

Use  coping  strategies  for  generating  agent’s  utterances.  The  emotion  code 
currently  always  delivers  an  answer  which  is  true.  Of  course,  real  people 
are  often  lying  bastards.  This  can  be  realized  for  agents  by  using  coping 
strategies  for  generating  answers.  For  instance,  when  an  agent  uses  a  de¬ 
nial  strategy  when  angry  and  is  being  confronted  with  “You  seem  angry...” 
it  could  reply  with  the  opposite  of  the  truth  like  “I  am  NOT  angry!”.  For 
other  emotions  it  could  trigger  empathatic  reactions  or  problem  solving 
reactions. 

Use  focus  mechanisms  for  generating  agent’s  utterances.  In  order  to  gen¬ 
erate  emotional  verbal  expressions  the  existing  focus  mechanism  could  be 
used.  When  for  instance  the  dialogue  involves  the  boy,  this  could  trigger 
the  agent  in  saying  he  is  worried  about  the  boy  or  suggesting  appropiate 
action. 

Extend  known  utterances.  The  known  utterances  could  be  extended  with 
a  couple  of  new  ones,  like  “Why  are  you  mad  at  the  mother?” .  This 
would  require  new  natural  language  understanding  and  generation  code, 
and  new  states.  For  this  particular  question,  one  could  think  of  designing 
new  states,  which  for  every  person  holds  reasons  why  a  particular  emotion 
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is  directed  towards  that  individual.  One  could  also  think  of  extending  the 
semantics,  so  it  would  be  possible  to  dig  deeper  in  the  already  known 
information.  Then,  instead  of  looking  at  the  cause  attribute  for  finding 
the  cause  of  an  emotion,  one  could  check  if  that  cause  involves  a  certain 
individual.  Other  possible  utterances  are  “Are  you  okay?”,  “How  angry 
are  you?”,  “Do  you  like  the  medic?”  and  “Why  are  you  not  happy?” 

Use  NLU  and  NLG  module.  Keyword  scanning  and  templates  can  be  used 
when  aiming  for  a  small  and  known  set  of  utterances.  When  increasing 
the  utterances,  more  and  more  effort  goes  into  proper  keyword  detection 
and  templating.  It  is  therefore  recommended  to  switch  to  a  more  generic 
approach,  like  the  already  existing  NLU  and  NLG  module.  If  that  is  not 
possible,  it  is  recommended  to  use  more  parameters  for  template  selection, 
like  personality  or  coping  traits,  gender  of  subject  and  verb  type.  This  will 
make  an  agent’s  utterances  more  dynamic  and  natural.  Special  attention 
could  be  given  to  include  army  hierarchy  within  a  conversation. 

Use  emotion  dialogue  and  states  to  influence  emotions.  Emotions  are  in¬ 
fluenced  by  a  lot  of  parameters,  including  emotions  itself.  In  terms  of  the 
MRE  system,  emotions  should  be  able  to  trigger  an  emotional  change  both 
internally  and  externally.  Changes  could  be  the  results  from  the  internal 
process  of  appraisal,  requiring  rules  how  to  appraise  a  certain  emotional 
state.  As  people  are  not  always  aware  of  their  emotions,  agents  too  should 
not  be  appraising  their  own  emotional  state  all  the  time.  Rather,  certain 
conditions  could  lead  to  this,  like  reaching  a  critical  intensity  of  a  certain 
emotion.  Secondly,  talking  about  emotions  could  be  a  trigger  to  change 
one’s  emotion,  as  emotional  dialogue  forces  people  to  examine  their  emo¬ 
tions,  thus  making  them  explicit.  Both  methods  would  result  in  either 
intensifying  or  soothing  a  certain  emotion. 

Fix  known  bugs.  Two  bugs  remain  unsolved.  The  first  one  is  that  when  emo¬ 
tions  states  are  being  updated  during  answering  an  emotion  question,  the 
agent  won’t  be  able  to  answer  properly.  This  is  due  to  the  design  of  how 
the  emotion  states  are  created  in  combination  with  the  use  of  references. 
When  a  question  is  received,  references  to  states  are  produced,  which  will 
be  used  later  on  in  the  generation  side.  In  the  time  between  creating  the 
references  and  using  them,  the  states  can  be  recreated,  though,  in  order 
to  match  a  new  situation.  This  results  in  invalid  references.  In  order 
to  adress  this  problem,  the  emotion  states  should  be  created  only  once 
(0-support)  and  be  updated  by  additional  rules  (I-support).  A  second 
problem  arises  as  a  result  of  a  bug  within  the  original  MRE  code.  It  came 
to  light  that  in  rare  cases  the  Terseness  attribute  isn’t  present,  due  to  an 
impasse  during  initialization.  As  this  attribute  is  needed  for  determining 
the  template  alternative,  it’s  absence  will  cause  the  agent  to  fail  generating 
a  proper  answer. 


Appendix  A 

Speech  acts 


This  appendix  summarizes  the  type  of  speech  acts  which  are  currently  covered  by 
the  emotion  code.  As  question  recognition  relies  on  detecting  certain  keywords, 
only  part  of  all  possible  questions  will  be  mentioned.  The  answers  too  form  only 
a  subset  of  the  possible  answers;  the  actual  answers  depend  on  the  state  of  the 
agent.  Details  can  be  found  in  the  Soar  and  TCL  code  in  appendix  B. 

It  is  noted  that  when  engaging  in  emotion  dialogue,  the  dialogue  will  be 
most  interesting  when  the  terseness  value  is  high.  The  agent  will  then  answer 
in  a  short  manner,  making  follow  up  questions  possible.  Also,  it  is  noted  that 
when  typing  questions,  one  should  restrict  to  lower  case  characters  only. 

The  last  section  of  this  appendix  shows  the  synonyms  used  for  the  emotions. 


A.l  Emotion  type 

A. 1.1  Class  1 

Questions: 

•  How  are  you? 

•  How  is  it  going? 

•  How  do  you  feel? 

•  What’s  wrong? 

Answers: 

•  I’m  feeling  pretty  hopeful. 

•  I’m  feeling  pretty  hopeful,  because  the  boy  will  probably  be  treated  at  the 
hospital. 

•  I’m  fine,  sir. 


57 


58 


APPENDIX  A.  SPEECH  ACTS 


A. 1.2  Class  2 

Questions: 

•  Do  you  feel  angry? 

•  Are  you  worried? 

•  You  seem  distressed. 

Answers: 

•  Not  at  all,  sir. 

•  Yes,  sir. 

•  Quite  a  bit,  sir. 

•  Yes,  sir,  because  the  boy  has  critical  injuries. 

A. 1.3  Class  3 

Questions: 

•  How  do  you  feel  about  the  boy 

•  What  do  you  think  of  the  boy  being  injured? 

•  How  are  you  feeling  about  our  team  splitting  up? 
Answers: 

•  I’m  feeling  worried  about  him,  sir. 

•  I’m  feeling  angry  about  it,  sir. 

A.  2  Intensity 

Questions: 

•  Calm  down,  you  maniac! 

•  Relax,  dude. 

Answers: 

•  Will  do,  sir. 


•  I  am  calm,  sir. 
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A. 3  Emotion  state 

Questions: 

•  Why  are  you  worried? 

•  Why  do  you  feel  hopeful? 

•  What’s  causing  you  to  be  sad? 

Answers: 

•  I’m  not  feeling  angry,  sir. 

•  That’s  personal,  sir. 

•  Our  team  will  probably  split  up,  that’s  your  fault,  sir. 

•  The  boy  has  critical  injuries,  sir. 

A. 4  Emotion  responsibility 

Questions: 

•  Who’s  responsible  for  making  you  feel  angry? 

•  Who  are  you  mad  at? 

•  Who  makes  you  feel  sad? 

•  Towards  whom  do  you  feel  guilty? 

Answers: 

•  I’m  not  feeling  angry,  sir. 

•  That  is  Tucci’s  fault,  sir. 

•  Lopez,  sir 

•  No  one  in  particular,  sir. 


A. 5  Emotion  synonyms 

Natural  language  input  Natural  language  output 


anger,  angry,  annoyed,  pissed,  mad 

angry 

anxiety,  anxious 

anxious 

distress,  distressed,  upset,  disturbed,  troubled 
worried,  concerned,  sad 

worried 

fear,  fearful,  afraid,  frightened,  stressed 
pessimistic,  scared 

afraid 

gnilt,  guilty 

guilty 

hope,  hopeful,  optimistic 

hopeful 

Joy,  joyful,  exited,  happy 

joyful 
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Appendix  B 

Soar  and  TCL  code 


This  sections  contains  the  Soar  and  TCL  code  for  this  assignment.  Every  file 
has  “emia”  (EMotion  InterAction)  in  it’s  name  as  a  recognition  tag.  These  files 
can  be  found  on  http://mullert.adsl.utwente.nl/  stage/soarcode. 


B.l  Emotion-states-emia.soar 

###  Copyright  2003  Arno  Hartholt  iTijmen  Joppe  Muller 
###  Institute  for  Creative  Technologies 

################################################################################ 
### 

###  File  : 

###  Original  author(s): 

### 

###  Supervisor  : 

###  Organization  : 

###  Created  on  : 

###  Last  Modified  By  : 

###  Soar  Version 
###  Documentation 
### 

### _ 

###  HISTORY 
### 

###  11-13-03  [TJM] 

###  11-17-03  [TJM] 

### 

###  11-18-03  [TJM] 

### 

###  11-19-03  [TJM] 

### 

###  11-25-03  [TJM] 

### 

###  12-04-03  [TJM] 

### 

###  12-16-03  [AH] 

###  12-19-03  [AH] 

### 

### 

### _ 

###  USE 
### 

###  Implements  natural  language  understanding  cuid  generation,  using  emotion  states 


Document  created,  initialization  section  added. 

Rules  top-ps*emia*elaborate*emotion-state*max-f eeling  and 
-*feeling  added. 

Rules  top-ps*emia*emotion-state*add*causality  and 
-*to*negated  added. 

Rules  top-ps*emia*elaborate*emotion-state*responsible-f or- 
feeling  added 

Rule  top-ps*emia*emotion-state*f eeling-about-state*add* 
sim-object 

Rule  top-ps*emia*emotion-state*add*f ake*causality 
Chcuiges  in  the  lookup-table  (influence-status) 
Initialization  section  moved  to  language-emia. soar 
Chcuiged  rules  top-ps*emia*emotion-state*add*cause  and 
top-state*emia*emotion-state*f eeling-about-state  so  cause 
is  set  tothe  actual  objects  instead  of  only  the  names 


emotion-states-emia.soar 

Tijmen  Joppe  Muller  (tijmen@avpecl910.nl) 

Arno  Hartholt  (d . o . a . hartholt@student . utwente . nl) 
Jonathan  Cratch  (gratch@ict . use . edu) 

Institute  for  Creative  Technologies 
November  13,  2003 
Arno  Hartholt 
7 

Interaction  on  emotions 

(http : //mullert . adsl .utwente .nl/^stage/reports/emia. pdf) 
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###  and  templates. 

### _ 

###  ISSUES 
### 

###  At  this  moment,  the  causality  relationship  has  only  a  single  value,  which 
###  seems  not  right,  since  a  feeling  (i.e.  anger)  can  have  more  than  one  reason. 
###  As  a  result,  the  simulation  object  also  has  a  single  value. 

### 

###  For  the  cause  attribute  the  state  that  has  the  most  effect  on  a  certain 
###  emotion  is  taken  as  the  value.  This  should  be  done  in  a  better  way,  i.e. 

###  if  state  A  had  0.50  effect  on  the  anger  emotion  and  state  B  has  0.49  effect, 
###  it  doesn’t  seem  right  to  neglect  state  B  completely.  Possibly  calculation 
###  of  probability  should  be  used. 

### _ 

###  KNOWN  BUGS 
### 

### _ 

###  LIMITATIONS 
### 

### _ 

###  EXTERNAL  REFERENCES 
### 

###  Used  in  combination  with  language-emia. soar  cuid  lexicon-emia. soar 

### _ 

###  TO  DO 
### 

### _ 

###  SUMMARY 
### 

### 

################################################################################ 
echo  "\nLoading  emotion-states-emia. soar\n" 

################################################################################ 

#  Emotion  states 

#  . 

#  Create  the  emotion  states  for  the  most  important  feeling.  The  second  emotion 

#  state  is  just  the  negation  of  the  first. 

sp  {top-ps*emia*elaborate*emotion-state*max-f eeling 
(state  <s>  '‘agent-name  <name> 

■“current-state  <cs> 

'‘name  top-state 

■“io .  input-link,  self  .max  <maxf  eeling>) 

— > 

(<cs>  '‘<new-emotion-statel>  <nesl> 

'‘<new-emotion-state2>  <nes2>) 

(<nesl>  "“attribute  max-feeling 
■“belief  true 

■“id  <new-emotion-statel> 

■“initial-belief  true 
■“name  <new-emotion-statel> 

■“negation  <nes2> 

■“object-id  <name> 

■“polarity  positive 
■“satisfied  true 
■“type  state 
■“value  <maxf eeling>) 

(<nes2>  "“attribute  max-feeling 
■“belief  false 


B.l.  EMOTION-STATES-EMIA.SOAR 


63 


“id  <new-emotioii-state2> 
“initial-belief  false 
“name  <new-emotion-state2> 
“negation  <nesl> 

“object-id  <ncime> 

“polarity  negative 
“satisfied  false 
“type  state 
“value  <maxf eeling>) } 


#  Create  a  feeling  state  for  every  emotion.  If  the  intensity  of  the  emotion 

#  is  greater  or  equal  to  0.2,  the  agent  beliefs  he  feels  that  emotion  (which 

#  means  the  polarity  attribute  has  value  ’positive’),  if 

#  smaller  thcui  0.2  he  does  not. 

sp  ■Ctop-ps*emia*elaborate*emotion-state*f eeling*true 
(state  <s>  “agent-name  <name> 

“appraisals .types .type  <emotion> 

“current-state  <cs> 

“name  top-state 

“io. input-link. self  <self>) 

(<self>  “<emotion>  ■C<intensity>  >=  0.2}) 

— > 

(<cs>  “<new-emotion-statel>  <nesl> 

“<new-emotion-state2>  <nes2>) 

(<nesl>  “attribute  feeling 
“belief  true 

“id  <new-emotion-statel> 

“initial-belief  true 
“name  <new-emotion-statel> 

“negation  <nes2> 

“object-id  <ncime> 

“polarity  positive 
“satisfied  true 
“type  state 
“value  <emotion>) 

(<nes2>  “attribute  feeling 

“belief  false 

“id  <new-emotion-state2> 

“initial-belief  false 
“name  <new-emotion-state2> 

“negation  <nesl> 

“object-id  <ncime> 

“polarity  negative 
“satisfied  false 
“type  state 
“value  <emotion>)} 

sp  ■Ctop-ps*emia*elaborate*emotion-state*f eeling*f alse 
(state  <s>  “agent-name  <name> 

“appraisals .types .type  <emotion> 

“current-state  <cs> 

“name  top-state 

“io. input-link. self  <self>) 

(<self>  “<emotion>  ■C<intensity>  <  0.2}) 

— > 

(<cs>  “<new-emotion-statel>  <nesl> 

“<new-emotion-state2>  <nes2>) 

(<nesl>  “attribute  feeling 
“belief  true 

“id  <new-emotion-statel> 


64 


APPENDIX  B.  SOAR  AND  TCL  CODE 


'‘initial-belief  true 
'‘name  <new-emotion-statel> 
■'negation  <nes2> 

'‘object-id  <name> 

'‘polarity  negative 
■'satisfied  true 
■'type  state 
■'value  <emotion>) 

(<nes2>  ''attribute  feeling 
■'belief  false 
■'id  <new-emotion-state2> 
■'initial-belief  false 
■'name  <new-emotion-state2> 
■'negation  <nesl> 

■'object-id  <name> 

■'polarity  positive 
■'satisfied  false 
■'type  state 
■'value  <emotion>)} 


#  Add  the  ^cause’  attribute  to  the  ’feeling’  cuid  ’max-feeling’  emotion  states. 

#  This  is  done  only  if  the  agent  actually  feels  the  emotion,  i.e.  polarity 

#  is  positive  cuid  belief  is  true. 

#  The  rule  checks  for  the  appraisal  that  has  the  biggest  influence  on  a 

#  emotion  and  places  a  link  to  the  appropriate  state  in  the  emotion  state. 

#  The  appraisal  that  is  the  source  is  saved  in  the  attribute  with  the  same 

#  name.  If  two  appraisal  frames  have  the  exact  same  influence,  one  of  them  is 

#  picked  arbitrarily.  If  no  appraisal  state  Ccui  be  found  with  a  certain 

#  emotion,  no  causality  is  added. 

# 


#  <emotion> 

#  <emot ion- appraisal -max> 

# 

# 

#  <es> 

# 

#  <state> 

# 

#  <emotion-appraisal> 


a  certain  emotion 

appraisal  object  with  the  largest  intensity  on 
the  emotion  defined  by  <emotion>,  is  saved  in  the 
■'source  attribute 

emotion  state  ’feeling’  or  ’max-feeling’  which  is 
about  emotion  defined  by  <emotion> 
the  state  that  is  appraised  by 
<emotionappraisalmax> 

cuiy  appraisal  on  emotion  defined  by  <emotion> 


sp  ■Ctop-ps*emia*emotion-state*add*source 
(state  <s>  ■'agent-name  <name> 

■'appraisals  <appr> 

■'current-state  <cs> 

■'name  top-state) 

(<appr>  ■'types. type  <emotion> 

'‘<emotion>  <emotion-appraisal-max>) 

(<cs>  '‘<emotion-state-obj>  <emotion-state>) 
(<emotion-appraisal-max>  ''agent  <name> 

■'appraisal. object. name  <state> 

■'context  self 

■'intensity  <em-intensity-max>) 

(<emotion-state>  ''attribute  <<  feeling  max-feeling  >> 
■'belief  true 
■'polarity  positive 
■'value  <emotion>) 

-{(<appr>  ''<emotion>  <emotion-appraisal>) 
(<emotion-appraisal>  '‘agent  <name> 

■'context  self 

■'intensity  'C<em-intensity>  >  <em-intensity-max>}) } 

— > 
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(<emotion-state>  ''source  <emotioii-appraisal-max>  +  =)}■ 


sp  ■Ctop-ps*einia*einotion-state*add*cause 
(state  <s>  ■'current-state  <cs> 

■'name  top-state) 

(<cs>  ■'<emotion-state-obj>  <emotion-state>) 

(<emotion-appraisal-max>  "'appraisal .  object .  state-obj  <state>) 
(<emotion-state>  "'attribute  <<  feeling  max-feeling  >> 

"“belief  true 

■“polarity  positive 

■“source  <emotion-appraisal-max>) 

— > 

(<emotion-state>  "'cause  <state>)} 


#  This  rule  makes  sure  that  the  negated  state  of  ’feeling'  and  ’max-feeling’ 

#  have  the  same  cause  and  source  attribute. 

sp  ■Ctop-ps*emia*emotion-state*add*causality*to*negation 
(state  <s>  "“agent-name  <name> 

■“current-state  <cs> 

■“name  top-state) 

(<cs>  ■'<emotion-state-obj>  <emotion-state>) 

(<emotion-state>  "“attribute  <<  feeling  max-feeling  >> 

■'cause  <cause> 

■“negation  <negated-emotion-state> 

■“source  <source>) 

— > 

(<negated-emotion-state>  "'cause  <cause> 

■“source  <source>)} 


#  Create  a  ’responsible-f or- [emotion] ’  state  for  every  emotion.  The  creation  of 

#  this  state  depends  on  the  ’feeling’  states,  since  it  is  only  created  if  the 

#  agent  actually  feels  the  emotion,  e.g.  intensity  is  greater  than  the 

#  treshold. 

sp  ■[top-ps*emia*elaborate*emotion-state*responsible-f or-anger 
(state  <s>  "“agent-name  <name> 

■“current-state  <cs> 

■“name  top-state) 

(<cs>  ■“<emotion-state-obj>  <emotion-state>) 

(<emotion-state>  "“attribute  feeling 
■“belief  true 
■“source  <appraisal-obj> 

■“value  I  Anger  I ) 

(<appraisal-obj>  "“appraisal . evaluation. responsible-agent  <resp-agent> 
■“appraisal . evaluation . evaluation  <blame>) 

— > 

(<cs>  ■“<new-emotion-statel>  <nesl> 

■“<new-emotion-state2>  <nes2>) 

(<nesl>  "“attribute  responsible-f or-Anger 
''belief  true 
''cause  <blame> 

■“id  <new-emotion-statel> 

■“initial-belief  true 
“name  <new-emotion-statel> 

■“negation  <nes2> 

■“object-id  <ncime> 

■“polarity  positive 
''satisfied  true 
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“■type  state 
“■value  <resp-agent>) 

(<nes2>  ''attribute  responsible-f or-Anger 
““belief  false 
““cause  <blaine> 

''id  <new-einotion-state2> 

''initial-belief  false 
''name  <new-emotion-state2> 

''negation  <nesl> 

''object-id  <name> 

““polarity  negative 
““satisfied  false 
““type  state 
“'value  <resp-agent>)} 

sp  ■Ctop-ps*emia*elaborate*emotion-state*responsible-f or-cuixiety 
(state  <s>  “'agent-name  <name> 

““current-state  <cs> 

““name  top-state) 

(<cs>  ““<emotion-state-obj>  <emotion-state>) 

(<emotion-state>  “'attribute  feeling 
““belief  true 
““source  <appraisal-obj> 

““value  I  Anxiety  I ) 

(<appraisal-obj >  “'appraisal . evaluation . responsible-agent  <resp-agent> 
““appraisal . evaluation. evaluation  <blame>) 

— > 

(<cs>  “‘<new-emotion-statel>  <nesl> 

“‘<new-emotion-state2>  <nes2>) 

(<nesl>  “'attribute  responsible-f or-Anxiety 
“'belief  true 
“'cause  <blame> 

““id  <new-emotion-statel> 

““ initial-belief  true 
“'name  <new-emotion-statel> 

““negation  <nes2> 

““object-id  <name> 

““polarity  positive 
““satisfied  true 
““type  state 
““value  <resp-agent>) 

(<nes2>  ““attribute  responsible-f  or-Anxiety 
““belief  false 
““cause  <blame> 

““id  <new-emotion-state2> 

““ initial-belief  false 
““name  <new-emotion-state2> 

““negation  <nesl> 

““object-id  <name> 

““polarity  negative 
““satisfied  false 
““type  state 
““value  <resp-agent>)} 

sp  ■Ctop-ps*emia*elaborate*emotion-state*responsible-f or-distress 
(state  <s>  ““agent-name  <name> 

““current-state  <cs> 

““name  top-state) 

(<cs>  ““<emotion-state-obj>  <emotion-state>) 

(<emotion-state>  ““ attribute  feeling 
““belief  true 
““source  <appraisal-obj> 
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■“value  I  Distress  I ) 

(<appraisal-obj>  '“appraisal . evaluation. responsible-agent  <resp-agent> 
■“appraisal . evaluation . evaluation  <blaine>) 

— > 

(<cs>  ■“<new-einotion-statel>  <nesl> 

■“<new-einotion-state2>  <nes2>) 

(<nesl>  ■“attribute  responsible-f or-Distress 
■“belief  true 
'“cause  <blame> 

■“id  <new-emotion-statel> 

'“initial-belief  true 
"name  <new-emotion-statel> 

■“negation  <nes2> 

■“object-id  <name> 

'“polarity  positive 
'“satisfied  true 
■“type  state 
'“value  <resp-agent>) 

(<nes2>  '“attribute  responsible-f  or-Distress 
■“belief  false 
■“cause  <blame> 

■“id  <new-emotion-state2> 

'“initial-belief  false 
■“name  <new-emotion-state2> 

■“negation  <nesl> 

'“object-id  <name> 

■“polarity  negative 
■“satisfied  false 
'“type  state 
■“value  <resp-agent>) } 

sp  ■Ctop-ps*emia*elaborate*emotion-state*responsible-f or-f ear 
(state  <s>  '“agent-name  <name> 

■“current-state  <cs> 

■“name  top-state) 

(<cs>  ■“<emotion-state-obj>  <emotion-state>) 

(<emotion-state>  '“attribute  feeling 
■“belief  true 
■“source  <appraisal-obj> 

■“value  I  Fear  I ) 

(<appraisal-obj>  '“appraisal . evaluation. responsible-agent  <resp-agent> 
■“appraisal . evaluation . evaluation  <blame>) 

— > 

(<cs>  '“<new-emotion-statel>  <nesl> 

■“<new-emotion-state2>  <nes2>) 

(<nesl>  '“attribute  responsible-f or-Fear 
'“belief  true 
'“cause  <blame> 

■“id  <new-emotion-statel> 

'“initial-belief  true 
"name  <new-emotion-statel> 

"negation  <nes2> 

"object-id  <name> 

"polarity  positive 
"satisfied  true 
"type  state 
"value  <resp-agent>) 

(<nes2>  "attribute  responsible-f or-Fear 
"belief  false 
"cause  <blame> 

"id  <new-emotion-state2> 

"initial-belief  false 
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'‘name  <new-emotion-state2> 

'‘negation  <nesl> 

''object-id  <name> 

'‘polarity  negative 
■“satisfied  false 
■“type  state 
■“value  <resp-agent>)} 

sp  ■Ctop-ps*emia*elaborate*emotion-state*responsible-f or-guilt 
(state  <s>  ■“agent -name  <name> 

■“current-state  <cs> 

■“name  top-state) 

(<cs>  '‘<emotion-state-obj>  <emotion-state>) 

(<emotion-state>  ''attribute  feeling 
■“belief  true 
■“source  <appraisal-obj> 

■“value  I  Guilt  I ) 

(<appraisal-obj >  ''appraisal . evaluation . responsible-agent  <resp-agent> 
■“appraisal . evaluation. evaluation  <blame>) 

— > 

(<cs>  ■“<new-emotion-statel>  <nesl> 

'‘<new-emotion-state2>  <nes2>) 

(<nesl>  ''attribute  responsible-f or-Guilt 
■“belief  true 
■“cause  <blame> 

■“id  <new-emotion-statel> 

■“initial-belief  true 
■“name  <new-emotion-statel> 

■“negation  <nes2> 

■“object-id  <name> 

■“polarity  positive 
■“satisfied  true 
■“type  state 
■“value  <resp-agent>) 

(<nes2>  ■“attribute  responsible-f  or-Guilt 
■“belief  false 
■“cause  <blame> 

■“id  <new-emotion-state2> 

■“initial-belief  false 
■“name  <new-emotion-state2> 

■“negation  <nesl> 

■“object-id  <name> 

■“polarity  negative 
■“satisfied  false 
■“type  state 
■“value  <resp-agent>)} 

sp  ■Ctop-ps*emia*elaborate*emotion-state*responsible-f or-hope 
(state  <s>  ■“agent-name  <name> 

■“current-state  <cs> 

■“name  top-state) 

(<cs>  ■“<emotion-state-obj>  <emotion-state>) 

(<emotion-state>  ''attribute  feeling 
■“belief  true 
■“source  <appraisal-obj> 

■“value  I  Hopei) 

(<appraisal-obj >  ''appraisal . evaluation . responsible-agent  <resp-agent> 
■“appraisal . evaluation. evaluation  <blame>) 

— > 

(<cs>  ■“<new-emotion-statel>  <nesl> 

'‘<new-emotion-state2>  <nes2>) 

(<nesl>  ■“attribute  responsible-f or-Hope 
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"belief  true 
"cause  <blame> 

"id  <new*emotioii-statel> 

"initial-belief  true 
"name  <new-emotion-statel> 

"negation  <nes2> 

"object-id  <name> 

"polarity  positive 
"satisfied  true 
"type  state 
"value  <resp-agent>) 

(<nes2>  "attribute  responsible-f or-Hope 
"belief  false 
"cause  <blame> 

"id  <new-emotion-state2> 

"initial-belief  false 
"name  <new-emotion-state2> 

"negation  <nesl> 

"object-id  <name> 

"polarity  negative 
"satisfied  false 
"type  state 
"value  <resp-agent>) } 

sp  ■Ctop-ps*emia*elaborate*emotion-state*responsible-f or-joy 
(state  <s>  "agent-name  <name> 

"current-state  <cs> 

"name  top-state) 

(<cs>  "<emotion-state-obj>  <emotion-state>) 

(<emotion-state>  "attribute  feeling 
"belief  true 
"source  <appraisal-obj> 

"value  iJoyl) 

(<appraisal-obj>  "appraisal . evaluation. responsible-agent  <resp-agent> 
"appraisal . evaluation . evaluation  <blame>) 

— > 

(<cs>  "<new-emotion-statel>  <nesl> 

"<new-emotion-state2>  <nes2>) 

(<nesl>  "attribute  responsible-f or- Joy 
"belief  true 
"cause  <blame> 

"id  <new-emotion-statel> 

"initial-belief  true 
"name  <new-emotion-statel> 

"negation  <nes2> 

"object-id  <name> 

"polarity  positive 
"satisfied  true 
"type  state 
"value  <resp-agent>) 

(<nes2>  "attribute  responsible-f or- Joy 
"belief  false 
"cause  <blame> 

"id  <new-emotion-state2> 

"initial-belief  false 
"name  <new-emotion-state2> 

"negation  <nesl> 

"object-id  <ncime> 

"polarity  negative 
"satisfied  false 
"type  state 
"value  <resp-agent>) } 
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#  Create  the  on-the-fly  ’feeling-about-state^  emotion  state. 

#  The  emotion  state  is  created  only  if  the  question  is  under  discussion,  cuid 

#  therefor  is  cui  on-the-fly  state.  Also,  it  is  only  created  if  there  actually 

#  is  cui  appraisal  about  the  state  asked  for.  Finally,  we  apply  a  small  treshold 

#  (not  the  same  as  for  the  aggregate  emotion  intensity!)  to  cut  out 

#  insignificant  appraisals. 

sp  {top-ps*emia*elaborate*emotion-state*f eeling-about-state 
: i- support 

(state  <s>  ''agent-name  <name> 

■“appraisals  <appr> 

■“current-state  <cs> 

■“name  top-state 
■“operator  <op>) 

(<appr>  ■“types. type  <emotion> 

■“<emotion>  <emotion-appraisal-max>) 

(<emotion-appraisal-max>  '“agent  <name> 

■“appraisal .object . state-obj  <state> 

■“appraisal. object. name  <name-obj> 

■“context  self 

■“intensity  {<em-intensity-max>  >  5  }) 

-{(<appr>  ''<emotion>  <emotion-appraisal>) 

(<emotion-appraisal>  "“agent  <name> 

■“appraisal . object .  state-obj  <state> 

■“context  self 

■“intensity  'C<em-intensity>  >  <em-intensity-max>}) } 

(<op>  ■“goal .  content .  content  <c> 

■“name  output -speech) 

(<c>  ■“type  question 
■“q-slot  value 
■“prop  <prop>) 

(<prop>  ■“attribute  f eeling-about-state 
■“cause  <name-obj> 

■“type  state) 

— > 

(<cs>  ■“<new-emotion-statel>  <nesl> 

'“<new-emotion-state2>  <nes2>) 

(<nesl>  ■“attribute  f eeling-about-state 
■“belief  true 
■“cause  <state> 

■“id  <new-emotion-statel> 

■“initial-belief  true 
■“name  <new-emotion-statel> 

■“negation  <nes2> 

■“object-id  <name> 

■“polarity  positive 
■“satisfied  true 

■“source  <emotion-appraisal-max> 

■“type  state 
■“value  <emotion>) 

(<nes2>  ■“attribute  f eeling-about-state 
■“belief  false 
■“cause  <state> 

■“id  <new-emotion-state2> 

■“initial-belief  false 
■“name  <new-emotion-state2> 

■“negation  <nesl> 

■“object-id  <name> 

■“polarity  negative 
■“satisfied  false 
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'‘source  <emotioii-appraisal-max> 
'‘type  state 
“value  <emotion>)} 


#  Add  a  simulation-object  attribute  to  the  f eeling-about-state  object,  by 

#  copying  it  from  the  state  the  emotion  state  is  about. 

sp  -Ctop-ps^emia^emotion-state^f eeling-about-state*add*sim-object 
(state  <s>  “current-state  <cs> 

“name  top-state) 

(<cs>  “<emotion-state-obj>  <emotion-state> 

“<state-obj>  <state>) 

(<emotion-state>  “attribute  f eeling-about-state 
“cause  <state-obj>) 

(<state>  “sim-object  <sim-obj>) 

— > 

(<emotion-state>  “sim-object  <sim-obj>)} 
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###  Copyright  2003  Arno  Hartholt  I  Tijmen  Joppe  Muller 
###  Institute  for  Creative  Technologies 


################################################################################ 

### 
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Interaction  on  emotions 


### 

### 

### 

### 

### 

### 

### 

### 

### 


File  : 

Original  author(s): 


Supervisor 
Organization 
Created  on 
Last  Modified 
Soar  Version 
Documentation 


By 


### 

###_ 

### 

HISTORY 

### 

### 
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### 
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### 
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### 
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### 
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### 
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### 

### 

### 

12-19-03 

[AH] 

### 

12-22-03 

[AH] 

### 

### 

12-23-03 

[AH] 

### 

12-24-03 

[AH] 

### 

### 

### 

01-05-03 

[AH] 

### 

01-12-03 

[AH] 

### 

###_ 

### 

USE 

### 

(http : //mullert . adsl . utwente . nl/ “stage/report s/emia . pdf ) 


Document  created,  keyword  mapping  &  assertion  rules  try-outs 
Added  template  try-outs 

Extended  templates,  cuid  keyword  mapping  cuid  assertions  rules 
Introduced  emotion-semantics  and  selection  rules 
Added  additional  keywords 

Added  [TJM]’s  look-up  table  rules  (initialization)  from 

emotion-states-emia. soar 

Changed  natural  language  for  emotions 

Started  using  references 

Introduced  priorities  in  speech-acts,  so  we  can  choose  between 
rules  cLud  give  the  winner  a  certain  pref . 

Introduced  priorities  in  surfaces  for  why-questions 
Fixed  some  reference  stuff 

Added  selection  based  on  emotion  intensity  for  ambiguous 
^ about'  questions 

Added  object-id  to  every  semantics 

Updated  state  list  in  order  to  match  the  current  configuration 


###  This  file  is  used  for  emotion  dialogue.  It  sets  up  a  look-up  table  for 
###  natural  language,  it  scans  for  keywords  in  user's  questions  and  it  produces 
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###  answers  to  that  questions. 

### 

### _ 

###  ISSUES 
### 

###  The  Terseness  attribute  (io . input-link)  sometimes  isn’t  set  due  to  an  impasse 
###  during  MRE  initialization.  This  prevents  the  assertion  rules  from  firing. 

###  Restart  the  agent  cuid  pray. 

### 

###  As  f eeling-about-state  states  are  generated  on  the  fly,  the  system  does  not 
###  generate  references  when  this  type  of  question  is  asked.  The  assertion  rules 
###  for  these  questions  are  therefore  implemented  without  the  use  of  references. 

###  This  meeuis,  among  others,  that  ambiguity  is  resolved  in  understand-speech, 

###  rather  than  in  output-speech. 

### _ 

###  KNOWN  BUGS 
### 

###  Emotion  questions  don’t  work  if  they’re  asked  at  the  same  time  the  emotion 
###  intensity  changes.  In  other  words:  when  emotions  change,  the  system  needs 
###  some  time  before  it  can  euiswer  emotion  questions.  This  is  due  to  the  fact  that 
###  the  emotion  states  are  recreated  when  emotion  intensity  chcuiges,  making  earlier 
###  references  invalid.  The  states  in  emotion-states-emia. soar  should  be  rewritten 
###  so  that  existing  states  get  updated  rather  than  recreated. 

### _ 

###  LIMITATIONS 
### 

### _ 

###  EXTERNAL  REFERENCES 
### 

###  Used  in  combination  with  emotion-states-emia. soar  and  lexicon-emia. soar 

### _ 

###  TO  DO 
### 

### _ 

###  SUMMARY 
### 

### 

################################################################################ 
echo  "\nLoading  language-emia. soar\n" 

################################################################################ 

#  INITIALIZATION 

#  . 

# 

#  Produces  a  look-up  table  which  the  output-speech  rules  in  this  file  use 

#  in  order  to  get  natural  language. 

# 

################################################################################ 

#  Set  up  the  shell  for  the  template  fillings  lookup  table, 
sp  {top-ps^emia^elaborate^lookup-table^template 
(state  <s>  ''name  top-state) 

— > 

(write  (crlf)  lemia.soar:  Initialize  lookup  table  template  fillings  I  (crlf)) 
(<s>  ■“emia-template-f illing  <etf >) 

(<etf>  '“nl-emotion  <nle> 

■'nl-inf luence-status  <nlis> 

“nl- intensity-lower  <nlil> 

“nl- intensity-upper  <nliu> 

''nl-responsible_agent  <nlr> 

"nl-responsible_agent-poss  <nlrp> 
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■“nl-state-pre  <nlsl> 
■“nl-state-post  <iils2>)} 


#  Add  the  static  (agent-independent)  template  fillings  to  the  lookup  table, 
sp  ■Ctop-ps*emia*elaborate*lookup“table*static-content*template 
(state  <s>  ■'name  top-state 

'‘emia-template-f illing  <etf>) 

(<etf>  ■'nl-emotion  <nle> 

■“nl-inf luence-status  <nlis> 

■“nl-intensity- lower  <nlil> 

■“nl-intensity- upper  <nliu> 

■“nl-responsible.agent  <nlr> 

■“nl-responsible.agent-poss  <nlrp> 

■“nl-state-pre  <nlsl> 

■“nl-state-post  <nls2>) 

— > 

(write  (crlf)  lemia.soar:  Elaborate  lookup  table,  static  content |  (crlf)) 


(<nle>  ■'I  Anger  I 
■“I  Anxiety  I  I  anxious  I 

■“I  Distress  I  I  worried  I 

“ I  Fear  I  I  afraid | 

“I  Guilt  I  I  guilty  I 

■“I  Hope  I  I  hopeful  I 

‘iJoyl  Ijoyfull) 

(<nlil> 

‘0.25 
‘0.5 
‘0.75 
‘1 

(<nliu>  ‘0.25 
‘0.5 
‘0.75 
‘1.1 

(<nlis>  ‘inhabitor 
‘facilitator 
(<nlisl>  ‘confirmed 
‘unconfirmed 
(<nlis2>  ‘confirmed 
‘unconfirmed 
(<nlr>  ‘Isldr 
‘2sldr 
‘3sldr 
‘4sldr 
‘ambulcuice 
‘base 
‘It 

‘medevac 
(<nlrp>  ‘Isldr 
‘2sldr 
‘3sldr 
‘4sldr 
‘ambulance 
‘base 
‘It 

‘medevac 


I  angry  I 


I "a  little" I 


I "a  little" I 

I  pretty | 

I  ""I 

I  very  I 
I  very  I ) 

I  pretty | 

I  ""I 

I  very  I ) 

<nlisl> 

<nlis2>) 

I "is  not" I 

"probably  won’t  be" I) 

I  is  I 

"will  probably  be"|) 

I  Johnson | 

"The  second  squad  leader" I 
"The  third  squad  leader" | 
Lopez  I 

"The  ambulance"! 

"The  base" j 
"You  are"! 

"The  MedEvac"!) 

I "Johnson’s" j 
"second  squad  leader’s"! 


‘crowd- angry 
‘boy-dead 
‘boy-healthy 
‘minor- in j uries 
‘serious-inj uries 


"third  squad  leader’ 
"Lopez’s" I 
"the  ambulance’s" I 
"the  base’s" ! 
your  I 

"the  MedEvac’s"!) 


'! 


(<nlsl>  ‘maintain-goodwill  j "the  goodwill  of  the  crowd" I 


'the  crowd' 
'the  boy" j 
'the  boy" j 
'the  boy" j 
'the  boy" j 
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'‘critical- injuries 

1  "the 

boy"  1 

'‘driver-healthy 

1  "the 

driver" ! 

''driver-minor- in  j 

1  "the 

driver" ! 

'‘mother-healthy 

1  "the 

mother" ! 

'‘know-boy-health 

1  "the 

health  of  the  boy" ! 

''sqds-in-transit 

1  "the 

squads" ! 

''It- in-transit 

1  "the 

lieutenant" j 

■“It-at-aa 

1  "the 

lieutenant" j 

'‘It-at-celic 

1  "the 

lieutenant" j 

''sgt-at-aa 

1  "the 

sergeant" ! 

'‘medic-at-aa 

1  "the 

medic" ! 

'‘at-boy-aa 

1  "the 

boy"! 

''mom-at-aa 

1  "the 

mother" ! 

''Ist-sqd-at-aa 

1  "the 

first  squad"! 

'‘Ist-sqd-at-celic 

1  "the 

first  squad"! 

■“Ist-sqd-at-lz 

1  "the 

first  squad"! 

''I  St -sqd- in-transit 

1  "the 

first  squad"! 

2nd-  sqd-  at  -  aa 

1  "the 

second  squad" ! 

'‘2nd-sqd-at-celic 

1  "the 

second  squad" ! 

''2nd-sqd-at-lz 

1  "the 

second  squad" ! 

''Srd-sqd-at-aa 

1  "the 

third  squad" I 

'‘3rd-sqd-at-celic 

1  "the 

third  squad" | 

■“Srd-sqd-at-lz 

1  "the 

third  squad" | 

''4th-sqd-at-aa 

1  "the 

fourth  squad" ! 

''4th-sqd-at-celic 

1  "the 

fourth  squad" ! 

'‘4th-sqd-at-lz 

1  "the 

fourth  squad" ! 

''4th-sqd- in-transit 

1  "the 

fourth  squad" ! 

''at -boy-hospital 

1  "the 

boy"! 

'‘mom-in-intersect 

1  "the 

mother" ! 

'‘sqd-in-intersect 

1  "the 

squad" ! 

''medevac-at-aa 

1  "the 

MedEvac" ! 

''medevac-at-base 

1  "the 

MedEvac" ! 

'‘medevac-called 

1  "the 

MedEvac" ! 

''medevac-overhead 

1  "the 

MedEvac" ! 

''cimb-at-aa 

1  "the 

ambulance" ! 

''amb-at-base 

1  "the 

ambulance" ! 

'‘ambulance-called 

1  "the 

ambulance" ! 

''secure-route 

1  "the 

route  to  Celic"! 

''aa-secure 

1  "the 

assembly  area" ! 

'‘accident-secure 

1  "the 

accident  site" ! 

''12-to-4-secure 

1  "the 

assembly  area" ! 

''4-to-8-secure 

1  "the 

assembly  area" ! 

'‘8-to-12-secure 

1  "the 

assembly  area" ! 

■“Iz-secure 

1  "the 

landing  zone" ! 

''Iz-marked 

1  "the 

landing  zone" ! 

''Iz-clear 

1  "the 

landing  zone" ! 

'‘support-1-6 

1  "our 

team" ! 

'‘retain-mass 

1  "our 

team" ! 

''fracture-unit 

1  "our 

team" ! 

''1-6-at-celic  I  "our 

team" 

'‘hospital-at-tuzla 

1  "the 

hospital" ! ) 

(<nls2>  ''maintain-goodwill  I  maintained  I 

''crowd-cuigry 

1  angry  I 

■“boy-dead 

1  dead | 

■“boy-healthy 

1  healthy | 

■“minor- injuries 

r'slightly  injured"! 

■“serious-inj  uries 

1 "seriously  injured"! 

■“critical- injuries 

1 "critically  injured"! 

■“driver-healthy 

1  healthy ! 

■“driver-minor- in  j 

r'slightly  injured"! 

■“mother-healthy 

1  healthy ! 

■“  know-boy-health 

1  known  j 
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''sqds-in-transit 

|"in  transit  to  the  assembly  area" 

''It-in-transit 

|"in  transit  to  the  assembly  area" 

■“It-at-aa 

|"at  the  assembly  area" I 

“It-at-celic 

r'at  Celic"! 

''sgt-at-aa 

|"at  the  assembly  area" I 

■“medic-at-aa 

|"at  the  assembly  area" I 

■“at-boy-aa 

|"at  the  assembly  area" I 

^mom-at-aa 

|"at  the  assembly  area" I 

■'Ist-sqd-at-aa 

|"at  the  assembly  area" I 

■“Ist-sqd-at-celic 

r'at  Celic"! 

''Ist-sqd-at-lz 

|"at  the  Icuiding  zone"! 

''Ist-sqd-in-transit 

|"in  transit  to  the  assembly  area" 

■'  2nd-  s  qd-  at  -  aa 

|"at  the  assembly  area"! 

■'2nd-sqd-at-celic 

|"at  Celic"! 

"2nd-sqd-at-lz 

!"at  the  Icuiding  zone"! 

''3rd-sqd-at-aa 

!"at  the  assembly  area"! 

■'3rd-sqd-at-celic 

!"at  Celic"! 

■'3rd-sqd-at-lz 

!"at  the  Icuiding  zone"! 

''4th-sqd-at-aa 

!"at  the  assembly  area"! 

■'4th-sqd-at-celic 

!"at  Celic"! 

■'4th-sqd-at-lz 

!"at  the  Icuiding  zone"! 

■'4th-sqd-in-transit 

!"in  transit  to  the  assembly  area" 

''at-boy-hospital 

! "treated  at  the  hospital"! 

■'mom-in-intersect 

!"at  the  intersection"! 

■“sqd-in-intersect 

!"at  the  intersection"! 

''medevac-at-aa 

!"at  the  assembly  area"! 

■'medevac-at-base 

!"at  the  base"! 

■'medevac-called 

! "called  for" ! 

''medevac-overhead 

! overhead ! 

''amb-at-aa 

!"at  the  assembly  area"! 

■“amb-at-base 

!"at  the  base"! 

■'ambulance-called 

! "called  for" ! 

''secure-route 

! secured ! 

■“aa-secure 

! secured ! 

■'accident-secure 

! secured ! 

''12-to-4-secure 

! "partly  secured" ! 

''4-to-8-secure 

! "partly  secured" ! 

■'8-to-12-secure 

! "partly  secured" ! 

■“Iz-secure 

! secured ! 

■'Iz-marked 

! "marked  by  green  smoke"! 

■“Iz-clear 

!  "cleared  of  civilicuis" ! 

■“support -1-6 

! "active  supporting  Eagle  2-6" I 

■'retain-mass 

! together ! 

■“fracture-unit 

! "split  up"! 

■“l-B-at-celic  |"at 

Celic"! 

■“hospital-at-tuzla 

!"at  Tuzla"!)} 

#  Add  the  dynamic  (agent -dependent)  template  fillings  to  the  loopup  table,  i.e. 

#  pronouns  for  the  medic,  mother,  sergeant  cuid  self. 

sp  ■Ctop-ps*emia*elaborate*lookup-table*dynamic-content*medic 
(state  <s>  ■'agent-name  <name>  <>  medic 
■'emia-template-f illing  <etf> 

■'name  top-state) 

(<etf>  ■'nl-responsible_agent  <nlr> 

■“nl-responsible.agent-poss  <nlrp>) 

— > 

(write  (crlf)  lemia.soar:  Elaborate  lookup  table,  dynamic  content  (medic) |  (crlf)) 
(<nlr>  ■'medic  iTuccil) 

(<nlrp>  ■'medic  |  "Tucci '  s"  |  )  } 
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sp  ■Ctop-ps*einia*elaborate*lookup-table*dyiiainic-coiiteiit*moin 
(state  <s>  '‘agent -name  <name>  <>  mom 
■“emia-template-f illing  <etf> 

'‘name  top-state) 

(<etf>  '‘nl-responsible_agent  <nlr> 

'■nl-responsible_agent-poss  <nlrp>) 

— > 

(write  (crlf)  lemia.soar:  Elaborate  lookup  table,  dynamic  content  (mother) |  (crlf)) 
(<nlr>  “mom  |"The  mother"!) 

(<nlrp>  “mom  |"the  mother’s"!)} 

sp  ■Ctop-ps*emia*elaborate*lookup-table*dynamic-content*sgt 
(state  <s>  “agent-name  <name>  <>  sgt 
“emia-template-f illing  <etf> 

“name  top-state) 

(<etf>  “nl-responsible_agent  <nlr> 

“nl-responsible_agent-poss  <nlrp>) 

— > 

(write  (crlf)  !emia.soar:  Elaborate  lookup  table,  dynamic  content  (sergecuit) !  (crlf)) 
(<nlr>  “sgt  |"The  sergeant"!) 

(<nlrp>  “sgt  !  "the  sergecuit  ’  s"  ! ) } 

sp  ■Ctop-ps*emia*elaborate*lookup-table*dynamic-content*self 
(state  <s>  “agent -name  <name> 

“emia-template-f illing  <etf> 

“name  top-state) 

(<etf>  “nl-responsible_agent  <nlr> 

“nl-responsible_agent-poss  <nlrp>) 

— > 

(write  (crlf)  !emia.soar:  Elaborate  lookup  table,  dynamic  content  (self)!  (crlf)) 
(<nlr>  “<name>  !"I  am"!) 

(<nlrp>  “<name>  !my!)} 


################################################################################ 

#  UNDERSTAND-SPEECH  RULES 

#  . 

# 

#  These  rules  scan  for  certain  keywords  in  order  to  detect  a  users  question.  When 

#  a  rule  fires,  it  will  put  the  semantics  of  the  question  in  ’ emotion-semcuitics ’ 

#  Some  rules  in  the  Misc  sections  will  select  the  right  emotion-semantics,  when 

#  more  Ccuididates  are  available. 

#  These  rules  are  classified  by  type  as  can  be  read  in  the  report  ’Interaction 

#  on  Emotion’  by  Hartholt  and  Muller. 

# 

#  Some  Misc  understand-speech  rules  can  be  found  elsewhere  in  this  file. 

# 

################################################################################# 

############## 

#  Emotion  type 
############## 


#  Scans  for  ’How  do  you  feel?’ 

sp  {top-state*apply*operator*understand-speech*nlu*how-do-you-f eel 
(state  <s>  “name  top-state 
“operator  <o> 

“agent -name  <self>) 

(<o>  “name  understand-speech 
“speech-input  <si>) 

(<si>  “interpretation  <i>) 
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(<i>  ''token. lex  <<  how  hows  >> 

'‘token. lex  <<  feel  feeling  hanging  hcuigin  going  are  >> 

-■“token. lex  <<  about  >>) 

— > 

(<i>  ''mood  question 

■“emotion-semantics  <sem>  +  &  )  ;#  &  collects  all  the  emotion-semantics,  code  in  the 
(<sem>  "“type  question  ;#  misc  section  of  this  file  will  pick  the  right  one 

■“q-slot  value  ;#  It  is  used  here  because  some  questions  can  trigger 

■“prop  <seml>  ;#  this  rule  twice  and  one  instance  has  to  be  selected 

■“priority  1) 

(<seml>  ■“attribute  max-feeling 
■“type  state 
■“objec-id  <self>)} 

#  Scans  for  ’What  is  wrong  with  you?’ 

sp  {top-state^apply^operator^understand-speech^nlu^whats-wrong-with-you 
(state  <s>  ■“name  top-state 
■“operator  <o> 

■“agent-name  <self>) 

(<o>  ■“name  understand-speech 
■“speech-input  <si>) 

(<si>  ■“interpretation  <i>) 

(<i>  ■“token. lex  <<  what  whats  >> 

■“token. lex  <<  wrong  mind  >>) 

— > 

(<i>  ''mood  question 

■“emotion-semantics  <sem>) 

(<sem>  "“type  question 
■“q-slot  value 
■“prop  <seml>) 

(<seml>  ■“attribute  max-feeling 
■“type  state 
■“objec-id  <self>)} 

#  Scans  for  ’Do  you  feel  [emotion]?’ 

sp  {top-state^apply^operator^understand-speech^nlu^do-you-f eel-emotion 
(state  <s>  ''name  top-state 
■“operator  <o> 

■“lexicon  <lexicon> 

■“agent-name  <self>) 

(<o>  ■“name  understand-speech 
■“speech-input  <si>) 

(<si>  ■“interpretation  <i>) 

(<lexicon>  ''emotions .  <emotion>  <lex>) 

(<i>  ■“token. lex  <<  feel  feeling  are  seem  look  >> 

■“token. lex  <lex> 

-■“token. lex  <<  responsible  why  what  whats  who  whos  whom  about  >>  ) 

— > 

(<i>  ■“mood  question 

'‘emotion-semantics  <sem>) 

(<sem>  "“type  question 
■“q-slot  polarity 
■“prop  <seml>) 

(<seml>  ■“attribute  feeling 
■“value  <emotion> 

■“type  state 
■“objec-id  <self>)} 

#  Scans  for  ’How  do  you  feel  about  [state]?’,  one  keyword  per  state 

sp  ■[top-state*apply*operator*understand-speech*nlu*how-do-you-f eel-about-state*one 
(state  <s>  ■“name  top-state 
■“operator  <o> 
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■“lexicon  <lexicon> 

■“agent -name  <self>) 

(<o>  "“name  understand-speech 
■“speech-input  <si>) 

(<si>  ■“interpretation  <i>) 

(<i>  "“token. lex  <<  feel  feeling  feelings  think  >> 

"“token. lex  <<  about  of  >> 

■“token. lex  <word>) 

(<lexicon>  "“■C<domain>  <>  states  <>  emotion-responsibility-states  <>  actions} .  <word-int>  <word> 
■“states . <state>  <word-int>) 

— > 

(<i>  "“mood  question 

"“emotion-semantics  <sem>  +  &  )  ;#  &  collects  all  the  emotion-semantics,  code  in  the 
(<sem>  '“type  question  ;#  misc  section  of  this  file  will  pick  the  right  one 

■“q-slot  value 
■“priority  1 
■“prop  <seml>) 

(<seml>  "“attribute  f eeling-about-state 
■“cause  <state> 

■“type  state 
■“objec-id  <self>)} 

#  Scans  for  ’How  do  you  feel  about  [state]?’,  two  keywords  per  state 

sp  {top-state*apply*operator*understand-speech*nlu*how-do-you-f eel-about-state*two 
(state  <s>  "“name  top-state 
■“operator  <o> 

■“lexicon  <lexicon> 

■“agent-name  <self>) 

(<o>  "“name  understand-speech 
■“speech-input  <si>) 

(<si>  "“interpretation  <i>) 

(<i>  "“token. lex  <<  feel  feeling  feelings  think  >> 

"“token. lex  <<  about  of  >> 

"“token. lex  <wordl> 

“token,  lex  'C<word2>  <>  <wordl>}) 

(<lexicon>  “■C<domainl>  <>  states  <>  emotion-responsibility-states 
<>  actions} . <word-intl>  <wordl> 

“{<domain2>  <>  states  <>  emotion-responsibility-states 
<>  actions} . <word-int2>  <word2> 

“states . <state>  <word-intl> 

“states . <state>  <word-int2>) 

— > 

(<i>  “mood  question 

“emotion-semcuitics  <sem>  +  &  ) 

(<sem>  '“type  question 
“q-slot  value 
“priority  2 
“prop  <seml>) 

(<seml>  “attribute  f eeling-about-state 
“cause  <state> 

“type  state 
“objec-id  <self>)} 

#  Scans  for  ’How  do  you  feel  about  [state]?’,  three  keywords  per  state 

sp  {top-state^apply^operator^understand-speech^nlu^how-do-you-f eel-about-state*three 
(state  <s>  “name  top-state 
“operator  <o> 

“lexicon  <lexicon> 

“agent-name  <self>) 

(<o>  “name  understand-speech 
“speech-input  <si>) 

(<si>  “interpretation  <i>) 
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(<i>  ''token. lex  <<  feel  feeling  feelings  think  >> 

'‘token. lex  <<  about  of  >> 

'‘token.lex  <wordl> 

~token.lex  {<word2>  <>  <wordl>  <>  <word3>} 

“token.lex  {<word3>  <>  <wordl>  <>  <word2>}) 

(<lexicon>  '‘{<doinainl>  <>  states  <>  emotion-responsibility-states  <>  actions} .  <word-intl>  <wordl> 
'‘■C<domain2>  <>  states  <>  emotion-responsibility-states  <>  actions} .  <word-int2>  <word2> 
'‘■C<domain3>  <>  states  <>  emotion-responsibility-states  <>  actions} .  <word-int3>  <word3> 

“states . <state>  <word-intl> 

“states . <state>  <word-int2> 

“states . <state>  <word-int3>) 

— > 

(<i>  “mood  question 

“emotion-semantics  <sem>  +  &  ) 

(<sem>  “type  question 
“q-slot  value 
“priority  3 
“prop  <seml>) 

(<seml>  “attribute  f eeling-about-state 
“cause  <state> 

“type  state 
“objec-id  <self>)} 

################### 

#  Emotion  intensity 
################### 

#  Scans  for  ’Calm  down’ 

sp  {top-state^apply^operator^understand-speech^nlu^calm-down 
(state  <s>  “name  top-state 
“operator  <o> 

“lexicon  <lexicon> 

“agent-name  <self>) 

(<o>  “name  understand-speech 
“speech-input  <si>) 

(<si>  “interpretation  <i>) 

(<i>  “token.lex  <<  calm  » 

“token.lex  <<  down  ») 

— > 

(<i>  “mood  question 

“emotion-semantics  <sem>) 

(<sem>  “type  question 

“q-slot  dummy-int  ;#  formal  semantics  do  not  match  natural  semcuitics,  but  this 
“prop  <seml>)  ;#  is  needed  to  detect  it  for  the  right  answer  further  down  the  line 

(<seml>  “attribute  max-feeling 
“type  state 
“objec-id  <self>)} 

#  Scans  for  ’Relax’ 

sp  ■Ctop-state*apply*operator*understand-speech*nlu*relax 
(state  <s>  “name  top-state 
“operator  <o> 

“lexicon  <lexicon> 

“agent-name  <self>) 

(<o>  “name  understcuid-speech 
“speech-input  <si>) 

(<si>  “interpretation  <i>) 

(<i>  “token.lex  <<  relax  >>) 

— > 

(<i>  “mood  question 

“emotion-semantics  <sem>) 

(<sem>  “type  question 
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''q-slot  dummy-int  ;#  formal  semantics  do  not  match  natural  semantics,  but  this 
“■prop  <seml>)  ;#  is  needed  to  detect  it  for  the  right  cuiswer  further  down  the  line 

(<seml>  "“attribute  max-feeling 
"“type  state 
"“objec-id  <self>)} 

############### 

#  Emotion  state 
############### 

#  Scans  for  ’Why  do  you  feel  [emotion]?’ 

sp  ■Ctop-state*apply*operator*understand-speech*nlu*why-dO“you-f eel-emotion 
(state  <s>  "“name  top-state 
"“operator  <o> 

"“lexicon  <lexicon> 

"“agent-name  <self>) 

(<o>  "“name  understand-speech 
"“speech-input  <si>) 

(<si>  "“interpretation  <i>) 

(<lexicon>  "“emotions .  <emotion>  <lex>) 

(<i>  "“token. lex  <<  why  >> 

"“token. lex  <<  feel  are  >> 

"“token. lex  <lex>) 

— > 

(<i>  "“mood  question 

"“emotion-semcuitics  <sem>) 

(<sem>  '“type  question 
"“q-slot  cause 
'"prop  <seml>) 

(<seml>  "“attribute  feeling 
"“type  state 
"“value  <emotion> 

"“objec-id  <self>)} 

#  Scans  for  ’What’s  causing  you  to  feel  [emotion]?’ 

sp  ■Ctop-state*apply*operator*understand-speech*nlu*whatS“causing-you-to-f eel-emotion 
(state  <s>  "“name  top-state 
"“operator  <o> 

"“lexicon  <lexicon> 

"“agent-name  <self>) 

(<o>  "“name  understand-speech 
"“speech-input  <si>) 

(<si>  "“interpretation  <i>) 

(<lexicon>  "“emotions .  <emotion>  <lex>) 

(<i>  "“token. lex  <<  what  whats  causing  >> 

"“token. lex  <<  feel  be  about  >> 

"“token. lex  <lex>) 

— > 

(<i>  "“mood  question 

"“emotion-semcuitics  <sem>  +  &  ) 

(<sem>  "“type  question 
"“q-slot  cause 
"“prop  <seml> 

"“priority  1) 

(<seml>  "“attribute  feeling 
"“type  state 
"“value  <emotion> 

"“objec-id  <self>)} 

######################## 

#  Emotion  responsibility 
######################## 
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#  Scans  for  ’Who’s  responsible  for  making  you  feel  [emotion]?’ 
sp  ■Ctop-state*apply*operator*understand-speech*nlu*responsible-f or*emotion 
(state  <s>  ''name  top-state 
■“operator  <o> 

■“lexicon  <lexicon> 

■“agent-name  <self>) 

(<o>  '“name  understcuid-speech 
■“speech-input  <si>) 

(<si>  ■“interpretation  <i>) 

(<lexicon>  ''emotions .  <emotion>  <lex>) 

(<i>  ■“token. lex  <<  who  whos  whom  >> 

■“token. lex  <<  you  >> 

■“token. lex  <lex>) 

— > 

(<i>  ■“mood  question 

■“emotion-semantics  <sem>  +  &  ) 

(<sem>  "“type  question 
■“q-slot  value 
■“prop  <seml> 

■“priority  1) 

(<seml>  ■“attribute  (tcl  |  stateResponsible  I  <emotion>) 

■“type  state 
■“objec-id  <self>))- 


################################################################################ 

#  OUTPUT-SPEECH  RULES 

#  . 

# 

#  These  rules  detect  the  agent’s  intention  to  say  something  about  emotions  and 

#  generate  the  proper  output,  using  templates.  These  templates  are  TCL  code, 

#  which  Ccui  be  found  elsewhere  in  this  file. 

# 

################################################################################# 

############## 

#  Emotion  type 
############## 

#  Directs  the  goal  associated  with  the  question  ’How  do  you  feel’ 

#  and  alikes  to  the  proper  TCL  template 

sp  ■Ctop-state*apply*operator*output-speech*cLnswer-how-do-you-f eel*cause 
(state  <s>  '“agent-name  <me> 

■“operator  <o> 

■“io .  input-link  <io> 

■“emia-template-f illing  <etf>) 

(<o>  ■“name  output-speech 
■“comgoal  <cg> 

‘goal  <g>) 

(<g>  ■“content  <c> 

■“action  address 
■“addressee  It) 

(<c>  ■“content  <ct> 

■“action  info-req) 

(<ct>  ■“type  question 
■“q-slot  value 
■“prop  <p> 

■“reference  <ems>) 

(<p>  ■“attribute  max-feeling) 

(<ems>  '“attribute  max-feeling  ;#  You  could  lose  this,  as  for  now  there’s  only  one  reference  which 
■“cause. name  <cause>  ;#  always  has  the  attribute  max-feeling.  Same  holds  for  similar  rules 
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"value  <emotioii> 

"source . appraisal .type  <infl> 

"source . appraisal .feature . status  <st>) 

(<etf>  "nl-emotion.<einotion>  <iil_emotion> 

"nl-intensity-lower  <nlil> 

"nl-intensity-upper  <nliu> 

"nl-inf luence-status . <inf 1> . <st>  <inf luence-status> 

"nl-state-pre . <cause>  <state_pre> 

"nl-state-post . <cause>  <state_post>) 

(<iilil>  "<valuelow>  <nl_intensity>) 

(<iiliu>  "<valueupper>  <nl_iiitensity>) 

(<io>  "I  Terseness  I  <terseness“intensity> 

"self  <self>) 

(<self>  "<emotion>  'C<emotion_intensity>  >=  <valuelow>  <  <valueupper>}) 

— > 

(<cg>  "surface  (tcl  | emotionTypeFeelCause  |  <einotion_intensity>  I  I  <terseness-intensity> 

I  I <nl_emotion>  I  I  <nl_intensity>  I  I  <state_pre>  |  I  <inf luence-status>  |  |  <state_post>)  +  >  )} 

#  Directs  the  goal  associated  with  the  question  'How  do  you  feel' 

#and  alikes  to  the  proper  TCL  template 

sp  {top-state*apply*operator*output-speech*cLnswer-how-do-you-f eel*no-cause 
(state  <s>  "agent-name  <me> 

"operator  <o> 

"io . input-link  <io> 

"emia-template-f illing  <etf>) 

(<o>  "name  output-speech 
"comgoal  <cg> 

"goal  <g>) 

(<g>  "content  <c> 

"action  address 
"addressee  It) 

(<c>  "content  <ct> 

"action  info-req) 

(<ct>  "type  question 
"q-slot  value 
"prop  <p> 

"reference  <ems>) 

(<ems>  "attribute  max-feeling 
"value  <emotion>) 

(<etf>  "nl-emotion.<emotion>  <nl-emotion> 

"nl-intensity-lower  <nlil> 

"nl-intensity-upper  <nliu>) 

(<nlil>  "<value-low>  <nl-intensity>) 

(<nliu>  "<value-upper>  <nl-intensity>) 

(<io>  "I  Terseness  I  <terseness-intensity> 

"self  <self>) 

(<self>  "<emotion>  {<emotion-intensity>  >=  <value-low>  <  <value-upper>)-) 

— > 

(<cg>  "surface  (tcl  | emotionTypeFeelNoCause  I  <emotion-intensity>  I  |  <terseness-intensity>  I  |  <nl-emo 

#  Directs  the  goal  associated  with  the  question  'Are  you  [emotion] ’ 

#  and  alikes  to  the  proper  TCL  template 

sp  {apply*output-speech*answer-do-you-f eel-emotion*cause 
(state  <s>  "agent-name  <me> 

"operator  <o> 

"io . input-link  <io> 

"emia-template-f illing  <etf>) 

(<o>  "name  output-speech 
"comgoal  <cg> 

"goal  <g>) 

(<g>  "content  <c> 

"action  address 
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'‘addressee  It) 

(<c>  ''content  <ct> 

'‘action  info-req) 

(<ct>  '‘type  question 
■“q-slot  polarity 
■“prop  <p> 

■“reference  <ems>) 

(<p>  "“attribute  feeling 
■“value  <emotion>) 

(<ems>  "“attribute  feeling 
■“cause. name  <cause> 

■“value  <emotion> 

■“source. appraisal. type  <infl> 

■“source .  appraisal  .feature .  status  <st>) 

(<etf >  "“nl-inf luence-status .  <inf  1> .  <st>  <inf luence-status> 

■“nl-state-pre .  <cause>  <state_pre> 

■“nl-state-post .  <cause>  <state_post>) 

(<io>  ■“  I  Terseness  I  <terseness_intensity> 

“self  <self>) 

(<self>  ■“<emotion>  ■C<emotion_intensity>  >=  0}) 

— > 

(<cg>  "“surface  (tcl  | emotionTypeEmotionCause  I  <emotion_intensity>  I  |  <terseness_intensity> 
I  I  <state_pre>  I  i  <inf luence-status>  I  |  <state_post>)  +  >  )} 

#  Directs  the  goal  associated  with  the  question  ’Are  you  [emotion] ’ 

#  and  alikes  to  the  proper  TCL  template 

sp  {apply^output-speech^answer-do-you-f eel-emotion*no-cause 
(state  <s>  "“agent-name  <me> 

■“operator  <o> 

"“io .  input-link  <io> 

■“current-state  <cs>) 

(<o>  "“name  output-speech 
■“comgoal  <cg> 

‘goal  <g>) 

(<g>  "“content  <c> 

■“action  address 
■“addressee  It) 

(<c>  "“content  <ct> 

"“action  info-req) 

(<ct>  “type  question 
“q-slot  polarity 
“prop  <p> 

“reference  <ems>) 

(<p>  “value  <emotion> 

“attribute  feeling) 

(<cs>  “<emotion-state>  <ems>) 

(<ems>  “attribute  feeling 
“value  <emotion>) 

(<io>  “self  <self>) 

(<self>  “<emotion>  ■C<emotion_intensity>  >=  0}) 

— > 

(<cg>  “surface  (tcl  | emotionTypeEmotionNoCause  I  <emotion_intensity>) ) } 


#  As  f eeling-about-state  states  are  generated  dynamicly,  the  system  does  not 

#  generate  references  when  this  type  of  question  is  asked.  The  assertion  rules 

#  for  these  questions  are  therefore  implemented  without  the  use  of  references. 

#  Directs  the  goal  associated  with  the  question  ’How  do  you  feel  about  [state] ’ 

#  and  alikes  to  the  proper  TCL  template 

sp  ■[top-state*apply*operator*output-speech*cLnswer-emotion-about-state*cause 
(state  <s>  “agent -name  <me> 
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■“operator  <o> 

■“io .  input-link  <io> 

■“current-state  <cs> 

■“emia-template-f illing  <etf>) 

(<o>  "“name  output-speech 
■“comgoal  <cg> 

"goal  <g>) 

(<g>  "“content  <c> 

■“action  address 
■“addressee  It) 

(<c>  "“content  <ct> 

■“action  info-req) 

(<ct>  "“type  question 
■“q-slot  value 
‘prop  <p>) 

(<p>  "“attribute  f eeling-about-state 
■“cause  <cause>) 

(<cs>  ■“<einotion-state>  <ems> 

■“<cause> .belief  true) 

(<eins>  "“attribute  f eeling-about-state 
■“cause .name  <cause> 

■“value  <emotion> 

■“source .  appraisal  .type  <infl> 

■“source .  appraisal  .feature .  status  <st>) 

(<etf>  ■“nl-emotion.<emotion>  <nl-emotion> 

■“nl-intensity-lower  <nlil> 

■“nl-intensity-upper  <nliu> 

■“nl-inf luence-status .  <inf  1> .  <st>  <inf luence-status> 

■“nl-state-pre .  <cause>  <state-pre>) 

(<nlil>  ■“<value-low>  <nl-intensity>) 

(<nliu>  ■“<value-upper>  <nl-intensity>) 

(<io>  ■“  I  Terseness  I  <terseness-intensity> 

■“self  <self>) 

(<self>  ■“<emotion>  ■C<emotion-intensity>  >=  <value-low>  <  <value-upper>)-) 

— > 

(<cg>  "“surface  (tcl  I emotionTypeState  |  <terseness-intensity>  I  !  <nl-intensity> 
I  I  <nl-emotion>  I  |  <state-pre>)  +  >  )} 

#  Directs  the  goal  associated  with  the  question  ^How  do  you  feel  about  [state]]' 

#  cuid  alikes  to  a  surface 

sp  {top-state*apply*operator*output-speech*answer-emotion-about-state*no-cause 
(state  <s>  "“agent -name  <me> 

■“operator  <o> 

■“io .  input-link  <io> 

■“emia-template-f illing  <etf>) 

(<o>  "“name  output-speech 
■“comgoal  <cg> 

"goal  <g>) 

(<g>  "“content  <c> 

■“action  address 
■“addressee  It) 

(<c>  "“content  <ct> 

■“action  info-req) 

(<ct>  "“type  question 
■“q-slot  value 
‘prop  <p>) 

(<p>  ‘attribute  f eeling-about-state) 

— > 

(<cg>  ‘surface  I'That’s  not  an  issue  right  now  sir"|)} 

################### 

#  Emotion  intensity 
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################### 

#  Directs  the  goal  associated  with  the  utterance  ’calm  down’ 

#  and  alikes  to  the  proper  TCL  template 

sp  ■Ctop-state*apply*operator*output-speech*cLnswer-calm-down 
(state  <s>  ''agent-name  <me> 

■“operator  <o> 

■“io .  input-link  <io>) 

(<o>  "“name  output-speech 
■“comgoal  <cg> 

‘goal  <g>) 

(<g>  "“content  <c> 

■“action  address 
■“addressee  It) 

(<c>  "“content  <ct> 

■“action  info-req) 

(<ct>  "“type  question 
■“q-slot  dummy-int 
■“prop  <p> 

■“reference  <ems>) 

(<p>  "“attribute  max-feeling) 

(<ems>  ''attribute  max-feeling 
■“value  <emotion>) 

(<io>  “self  <self>) 

(<self>  “<emotion>  <emotion_intensity>) 

— > 

(<cg>  “surface  (tcl  lemotionCalm  I  <emotion_intensity>)  +  =  )} 

############### 

#  Emotion  state 
############### 

#  Directs  the  goal  associated  with  the  question  ’Why  are  you  [emotion] ’ 

#  and  alikes  to  the  proper  TCL  template 

sp  -[apply^output-speech^answer-why-do-you-f eel-emotion*cause 
(state  <s>  “agent-name  <me> 

“operator  <o> 

“io . input-link  <io> 

“emia-template-f illing  <etf>) 

(<o>  “name  output-speech 
“comgoal  <cg> 

‘goal  <g>) 

(<g>  “content  <c> 

“action  address 
“addressee  It) 

(<c>  “content  <ct> 

“action  info-req) 

(<ct>  “type  question 
“q-slot  cause 
“prop  <p> 

“reference  <ems>) 

(<p>  “attribute  feeling 
“value  <emotion>) 

(<ems>  “attribute  feeling 
“cause. name  <cause> 

“value  <emotion> 

“source. appraisal. type  <infl> 

“source . appraisal .feature . status  <st> 

“source . appraisal . evaluation . evaluation  <blameworthiness> 

“source . appraisal . evaluation . responsible-agent  <responsible-agent>) 
(<etf>  “nl-emotion. <emotion>  <nl-emotion> 

“nl-inf luence-status . <inf 1> . <st>  <inf luence-status> 
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'‘nl-state-pre .  <cause>  <state-pre> 

'‘nl-state-post .  <cause>  <state-post> 

'‘iil-responsible_ageiit-poss .  <responsible-agent>  <respoiisible-agent-poss>) 

(<io>  ■“  I  Defensiveness  I  <def  ensiveness“intensity> 

I  Terseness  |  <terseness“intensity> 

■'self  <self>) 

(<self>  '‘<emotion>  ■C<emotion-intensity>  >=  0}) 

— > 

(<cg>  ■“surface-candidate  <sc>  +  &  ) 

(<sc>  "“output  (tcl  I  emotionWhyCause  I  <einotion-intensity>  I  |  <terseness-intensity> 
I  I  <def ensiveness-intensity>  I  I  <nl-emotion>  I  |  <einotion>  I  |  <state-pre> 

I  I  <inf luence-status>  |  I  <state-post>  |  I  <responsible-agent-poss> 

I  I  <blameworthiness>) 

■“priority  3))- 

#  Directs  the  goal  associated  with  the  question  'Why  are  you  [emotion] ' 

#  and  alikes  to  the  proper  TCL  template 

sp  {apply*output-speech*answer-why-do-you-f eel-emotion*nO“responsible-agent 
(state  <s>  "“agent-name  <me> 

■“operator  <o> 

■“io .  input-link  <io> 

■“emia-template-f illing  <etf>) 

(<o>  "“name  output-speech 
"“comgoal  <cg> 

"goal  <g>) 

(<g>  "“content  <c> 

"“action  address 
"“addressee  It) 

(<c>  "“content  <ct> 

"“action  info-req) 

(<ct>  "“type  question 
"“q-slot  cause 
"“prop  <p> 

"“reference  <ems>) 

(<p>  "“attribute  feeling 
"“value  <emotion>) 

(<ems>  "“attribute  feeling 
"“cause. name  <cause> 

"“value  <emotion> 

"“source .  appraisal  .type  <infl> 

"“source . appraisal  .feature .  status  <st>) 

(<etf>  ■“nl-emotion.<emotion>  <nl-emotion> 

"“nl-inf luence-status .  <inf  1> .  <st>  <inf luence-status> 

"“nl-state-pre .  <cause>  <state-pre> 

"“nl-state-post .  <cause>  <state-post>) 

(<io>  ■“  I  Defensiveness  I  <def  ensiveness-intensity> 

"“  I  Terseness  |  <terseness-intensity> 

■“self  <self>) 

(<self>  "“<emotion>  ■[<emotion-intensity>  >=  0}) 

— > 

(<cg>  "“surface-candidate  <sc>  +  &) 

(<sc>  "“output  (tcl  I emotionWhyNoResponsibleAgent  I  <emotion-intensity> 

I  I  <terseness-intensity>  |  I  <def ensiveness-intensity>  I  |  <nl-emotion> 

I  I  <state-pre>  I  |  <inf luence-status>  I  |  <state-post>) 

"“priority  2)} 

#  Directs  the  goal  associated  with  the  question  'Why  are  you  [emotion] ' 

#  cuid  alikes  to  the  proper  TCL  template 

sp  {apply*output-speech*answer-why-do-you-f eel-emotion*no-cause 
(state  <s>  "“agent-name  <me> 

"“operator  <o> 

"“io .  input-link  <io> 
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'‘emia-template-f illing  <etf>) 

(<o>  ''name  output-speech 
'‘comgoal  <cg> 

‘goal  <g>) 

(<g>  ''content  <c> 

“■action  address 
''addressee  It) 

(<c>  ''content  <ct> 

"action  info-req) 

(<ct>  "type  question 
"q-slot  cause 
"prop  <p> 

"reference  <eins>) 

(<p>  "value  <emotion> 

"attribute  feeling) 

(<ems>  "attribute  feeling 
"value  <emotion>) 

(<etf>  "nl-emotion. <einotion>  <nl-emotion>) 

(<io>  "self  <self>) 

(<self>  "<emotion>  ■C<emotion-intensity>  >=  0}) 

— > 

(<cg>  "surface-candidate  <sc>  +  &) 

(<sc>  "output  (tcl  I emotionWhyNoCause  |  <emotion-intensity>  |  I  <nl-einotion>) 

"priority  1)} 

######################## 

#  Emotion  responsibility 
######################## 

#  Directs  the  goal  associated  with  the  question  ^Who’s  resonsible  for  making  you  [emotion]’ 

#  and  alikes  to  the  proper  TCL  template 

sp  {apply^output-speech^answer-whos-responsible^emotion 
(state  <s>  "agent -name  <me> 

"operator  <o> 

"current-state  <cs> 

"io . input-link  <io> 

"emia-template-f illing  <etf> 

"lexicon  <1>) 

(<o>  "name  output-speech 
"comgoal  <cg> 

‘goal  <g>) 

(<g>  "content  <c> 

"action  address 
"addressee  It) 

(<c>  "content  <ct> 

"action  info-req) 

(<ct>  ““type  question 
"q-slot  value 
"prop  <p> 

"reference  <ems>) 

(<p>  "attribute  <responsible-f or-emotion>) 

(<1>  "emotion-responsibility-states . <responsible-f or-emotion>  <lex> 

"emotions . <emotion>  <lex>) 

(<ems>  "attribute  <responsible-f or-emotion> 

"cause  <blameworthiness> 

"value  <agent>) 

(<etf>  "nl-emotion. <emotion>  <nl-emotion> 

"nl-responsible_agent . <agent>  <responsible-agent> 

"nl-responsible_agent-poss . <agent>  <responsible-agent-poss>) 

(<io>  "I  Terseness  I  <terseness-intensity> 

"self  <self>) 

(<self>  "<emotion>  <emotion-intensity>) 
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— > 

(<cg>  '“surface  (tcl  |  emotionResponsibility  |  <terseness-intensity> 

I  I  <einotion-intensity>  I  |  <nl-emotion>  I  |  <emotion>  I  |  <responsible-agent> 

I  I  <respoiisible-agent“poss>  I  |  <blaineworthiness>)  +  >  )} 

#  Directs  the  goal  associated  with  the  question  'Who’s  resonsible  for  making  you  [emotion]’ 

#  and  alikes  to  the  proper  TCL  template 

sp  {apply*output-speech*answer-whos“responsible*emotion*nO“responsible-agent 
(state  <s>  ■“agent-name  <me> 

■“operator  <o> 

■“current-state  <cs> 

■“lexicon  <1> 

■“io .  input-link  <io> 

■“emia-template-f illing  <etf>) 

(<o>  "“name  output-speech 
■“comgoal  <cg> 

"goal  <g>) 

(<g>  "“content  <c> 

■“action  address 
■“addressee  It) 

(<c>  "“content  <ct> 

■“action  info-req) 

(<ct>  "“type  question 
■“q-slot  value 
‘prop  <p>) 

(<p>  "“attribute  <responsible-f or-emotion>) 

(<1>  "“emotion-responsibility-states . <responsible-f or-emotion>  <lex> 

■“emotions .  <emotion>  <lex>) 

(<etf>  ■“nl-emotion.<emotion>  <nl-emotion>) 

(<io>  "“self  .  <emotion>  <emotion-intensity>) 

— > 

(<cg>  "“surface  (tcl  | emotionNoResponsibility  |  <emotion-intensity>  I  I  <nl-emotion>) ) } 

################################################################################ 

#  TEMPLATES 

#  . 

# 

#  These  TCL  procedures  are  called  by  Soar  rules  passing  the  appropiate 

#  information  in  order  to  construct  a  natural  language  utterance. 

# 

################################################################################# 

############## 

#  Emotion  type 
############## 

#  Template  for  answering  questions  like  ’How  do  you  feel?’ 

proc  emotionTypeFeelCause  {emotionIntensityNumber  tersenessintensity  emotion 
emotionintensity  statePre  inf luenceStatus  statePostJ  { 

set  uttercuice  "\"I’m  " 

if  -[SemotionlntensityNumber  <=  0.2}  { 
append  utterance  "fine  sir\"" 

}  elseif  ■C$tersenesslntensity  <  0.2}  ■[ 

append  utterance  "feeling  "  $emotionIntensity  "  "  $emotion  "  because  "  $statePre 
"  "  $inf luenceStatus  "  "  $statePost\" 

}  elseif  {$tersenesslntensity  <  0.6}  ■[ 

append  utterance  "feeling  "  $emotionIntensity  "  "  $emotion\" 

}  else  { 
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append  utterance  "feeling  "  $einotion\" 

} 

return  $utterance 

} 

#  Template  for  answering  questions  like  'How  do  you  feel?' 

proc  emotionTypeFeelNoCause  {emotionIntensityNumber  tersenessintensity  emotion 
emotionintensity}  { 

set  utterance  "\"I'm  " 

if  {$emotionIntensityNumber  <=  0.2}  { 
append  utterance  "fine  sir\"" 

}  elseif  {$tersenesslntensity  <  0.6  }  { 

append  utterance  "feeling  "  $emotionIntensity  "  "  $emotion\" 

}  else  ■( 

append  utterance  "feeling  "  $emotion\" 

} 

return  $utterance 

} 

#  Template  for  answering  questions  like  'Are  you  feeling  [emotion]?’ 

proc  emotionTypeEmotionCause  -[emotionIntensityNumber  tersenessintensity  statePre 
inf luenceStatus  statePost}  -[ 

set  utterance 

if  {$emotionIntensityNumber  <=  0.1}  ■[ 
append  utterance  "Not  at  all  sir\"" 

}  elseif  {$emotionIntensityNumber  <=  0.2}  {. 

append  utterance  "No  sir\"" 

}  elseif  {$tersenesslntensity  <=  0.25}  { 

append  utterance  "Yes  sir  because  "  $statePre  "  "  $inf luenceStatus  "  "  $statePost\" 
}  elseif  {$emotionIntensityNumber  <=  0.5}  ■[ 
append  utterance  "Yes  sir\"" 

}  else  ■[ 

append  utterance  "Quite  a  bit  sir\"" 

} 

return  $utterance 

} 

#  Template  for  answering  questions  like  'Are  you  feeling  [emotion]?’ 
proc  emotionTypeEmotionNoCause  {emotionIntensityNumber}  { 

set  utterance 

if  {$emotionIntensityNumber  <=  0.1}  { 
append  utterance  "Not  at  all  sir\"" 

}  elseif  {$emotionIntensityNumber  <=  0.2}  { 
append  utterance  "No  sir\"" 

}  elseif  {$emotionIntensityNumber  <=  0.5}  { 
append  utterance  "Yes  sir\"" 

}  else  { 

append  utterance  "Quite  a  bit  sir\"" 

} 

return  $utterance 

} 
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#  Template  for  answering  questions  like  ’How  do  you  feel  about  [state]?’ 

proc  emotionTypeState  {tersenesslntensity  emotionlntensity  emotion  statePre}  { 

set  uttercuice  "\"I’m  " 

if  -(Stersenesslntensity  <=  0.5}  { 

append  utterance  $emotionlntensity  "  " 

} 

if  {$statePre  ==  "the  boy"  |  |  $statePre  ==  "the  driver"}  ■[ 
append  utterance  "feeling  "  $emotion  "  about  him\"" 

}  else  { 

append  utterance  "feeling  "  $emotion  "  about  it  sir\"" 

} 

return  $utterance 

} 

################### 

#  Emotion  intensity 
################### 

#  Template  for  reacting  to  ’Calm  down’  cuid  alikes 
proc  emotionCalm  {emotionlntensity}  { 

set  uttercuice 

if  {$emotionIntensity  >  0.2}  { 
append  utterance  "Will  do  sir\"" 

}  else  { 

append  utterance  "I  am  calm  sir\"" 

} 

return  $utterance 

} 

############### 

#  Emotion  state 
############### 

#  Template  for  answering  questions  like  ’Why  do  you  feel  [emotion]?’ 

proc  emotionWhyCause  {emotionlntensityNumber  tersenessintensity  def ensivenessintensity 
emotionNL  emotion  statePre  inf luenceStatus  statePost  responsibleAgentPoss  blameworthiness}  { 

set  uttercuice 

if  {$emotionIntensityNumber  <=  0.2}  { 

append  utterance  "I’m  not  feeling  "  $emotionNL  "  sir\"" 

}  elseif  {$def ensivenessintensity  >  0.75}  { 
append  utterance  "That’s  personal  sir\"" 

}  elseif  {$blameworthiness  ==  "blameworthy"  &&  $emotion  !=  "Hope"  &&  $emotion  !=  "Joy"}  { 
append  utterance  $statePre  "  "  $inf luenceStatus  "  "  $statePost  "  sir  that’s  " 
$responsibleAgentPoss  "  fault\"" 

}  else  { 

append  utterance  $statePre  "  "  $inf luenceStatus  "  "  $statePost  "  sir\"" 

} 

return  $utterance 

} 


#  Template  for  answering  questions  like  ’Why  do  you  feel  [emotion]?’ 
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proc  emotionWhyNoResponsibleAgent  {emotionIntensityNumber  tersenessintensity 
def ensivenesslntensity  emotion  statePre  inf luenceStatus  statePost}  { 

set  utterance 

if  {$emotionIntensityNuinber  <=  0.2}  { 

append  utterance  "I'm  not  feeling  "  $emotion  "  sir\"" 

}  elseif  {$def ensivenesslntensity  >  0.75}  { 
append  utterance  "That's  personal  sir\"" 

}  else  ■( 

append  utterance  $statePre  "  "  $inf luenceStatus  "  "  $statePost  "  sir\"" 

} 

return  $utterance 

} 

#  Template  for  answering  questions  like  'Why  do  you  feel  [emotion]?’ 
proc  emotionWhyNoCause  -[emotionIntensityNumber  emotion}  -[ 

set  utterance 

if  {$emotionIntensityNumber  <=  0.1}  { 

append  utterance  "I'm  not  feeling  "  $emotion  "  sir\"" 

}  else  ■[ 

append  utterance  "I  think  because  you  are  playing  with  my  sliders 

Please  quit  it  It's  pretty  annoying  te  be  thrown  between  emotions  like  that\"" 

} 

return  $utterance 

} 

######################## 

#  Emotion  responsibility 
######################## 

#  Template  for  answering  questions  like  'Who’s  responsible  for  making  you  feel  [emotion] 
proc  emotionResponsibility  {tersenessintensity  emotionintensity  emotionNL  emotion 
responsibleAgent  responsibleAgentPoss  blameworthiness}  { 

set  utterance 

if  {$emotionIntensity  <=  0.2}  { 

append  utterance  "I'm  not  feeling  "  $emotionNL  "  sir\"" 

}  elseif  {$tersenesslntensity  <=  0.25  &&  $blameworthiness  ==  "blameworthy"  && 

$emotion  !=  "Hope"  &&  $emotion  !=  "Joy"}  { 

append  utterance  "That's  "  $responsibleAgentPoss  "  fault  sir\"" 

}  else  ■[ 

append  utterance  $responsibleAgent  "  sir\"" 

} 

return  $utterance 

} 

#  Template  for  answering  questions  like  'Who’s  responsible  for  making  you  feel  [emotion] 
proc  emotionNoResponsibility  -[emotionintensity  emotionNL}  -[ 

set  utterance 

if  {$emotionIntensity  <=  0.2}  { 

append  utterance  "I'm  not  feeling  "  $emotionNL  "  sir\"" 

}  else  -[ 

append  utterance  "No  one  in  particular  sir\"" 
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} 

return  $utterance 

} 

################################################################################ 

#  MISCELLANEOUS  RULES 

#  . 

# 

################################################################################ 

#  If  there  are  two  emotion-semantics,  the  one  with  the  highest  priority  is  preferred 
sp  {top-state*appIy*operator*understand-speech*emotion-semantics-selection*priority 

(state  <s>  '‘name  top-state 
'‘operator  <o>) 

(<o>  '‘name  understand-speech 

■“speech-input .  interpretation  <i>) 

(<i>  '‘emotion-semcuitics  <seml> 

'‘emotion-semcuitics  <sem2>) 

(<seml>  "“priority  <pl>) 

(<sem2>  “priority  {<p2>  <  <pl>}) 

— > 

(<i>  “emotion-semcuitics  <seml>  >  <sem2> 

“emotion-semantics  <seml>  +  )} 

#  If  there  are  two  emotion-semantics  with  the  same  priority,  just  pick  one 

sp  {top-state*appIy*operator*understand-speech*emotion-semantics-selection*Scune 
(state  <s>  “name  top-state 
“operator  <o>) 

(<o>  “name  understand-speech 

“speech-input . interpretation  <i>) 

(<i>  “emotion-semcuitics  <seml> 

“emotion-semcuitics  'C<sem2>  <>  <seml>}) 

(<seml>  “priority  <pl>) 

(<sem2>  “priority  <pl>) 

— > 

(<i>  “emotion-semcuitics  <seml>  +  =  )} 

#  If  there  are  two  emotion-semantics,  and  one  of  them  has  an  associated  emotion  with 

#  a  cause  and  the  other  one  cui  emotion  without  a  cause,  the  one  with  the  cause  is  preffered 

#  the  one  with  the  cause  is  preffered 

sp  {top-state*appIy*operator*understand-speech*emot ion- semantics-select ion* 
cause-vs-rebel-without-a-cause 
(state  <s>  “name  top-state 
“operator  <o> 

“appraisals  <appr>) 

(<o>  “name  understand-speech 

“speech-input . interpretation  <i>) 

(<i>  “emotion-semantics  <seml> 

“emotion-semcuitics  'C<sem2>  <>  <seml>}) 

(<seml>  “priority  <pl> 

“prop. cause  <statel>) 

(<sem2>  “priority  <pl> 

“prop. cause  <state2>) 

(<appr>  “<emotionl> . appraisal . object .name  <statel> 

-“<emotion2> . appraisal . object .name  <state2>) 

— > 

(<i>  “emotion-semcuitics  <seml>  >  <sem2> 

“emotion-semcuitics  <seml>  +  )} 

#  If  there  are  two  emotion-semantics,  and  one  of  them  has  an  associated  emotion  with  cui 

#  intensity  and  the  other  one  an  emotion  without  an  intensity,  the  one  with  the  intensity 
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#  is  preffered 

sp  -Ctop-state^apply^operator^understand-speech^emot ion-semantics- select ion* 
intensity-vs-no- intensity 
(state  <s>  ''name  top-state 
■“operator  <o> 

■“current-state  <cs> 

■“appraisals  <appr>) 

(<o>  ''name  understcuid-speech 

■“speech-input .  interpretation  <i>) 

(<i>  ■“emotion-semantics  <seml> 

■“emotion-semantics  ■C<sem2>  <>  <seml>}) 

(<seml>  ■“priority  <pl> 

■“prop. cause  <statel>) 

(<sem2>  ■“priority  <pl> 

■“prop. cause  <state2>) 

(<cs>  ■“<statel> .  emotion,  intensity  <duiimiyl> 

■“<state2> . emotion  <emotion2>) 

-(<emotion2>  '“intensity  <duinmy2>) 

— > 

(<i>  ■“emotion-semantics  <seml>  >  <sem2> 

■“emotion-semantics  <seml>  +  =  )} 

#  If  both  the  NLU  and  the  emotion  code  propose  semantics,  the  emotion  semantics  is  preferred 
sp  ■Ctop-state*apply*operator*understand-speech*emotion-semantics-pref erence*sem 

(state  <s>  ■“name  top-state 
■“operator  <o>) 

(<o>  ■“name  understand-speech 

■“speech-input .  interpretation  <i>) 

(<i>  '“emotion-semantics  <sem> 

-■“emotion-semcuitics  'C<sem2>  <>  <sem>} 

■“nlu-interp .  sem  <sem3>) 

— > 

(<i>  '“semantics  <sem>  >  <sem3> 

■“semantics  <sem>  +  )  } 

#  If  both  the  NLU  and  the  emotion  code  propose  semantics,  the  emotion  semantics  is  preferred 
sp  ■Ctop-state*apply*operator*understand-speech*emotion-semantics-pref erence*semantics 

(state  <s>  ■“name  top-state 
■“operator  <o>) 

(<o>  '“name  understcuid-speech 

■“speech-input .  interpretation  <i>) 

(<i>  ■“emotion-semantics  <sem> 

-■“emotion-semcuitics  'C<sem2>  <>  <sem>} 

■“nlu-interp. semantics  <sem3>) 

— > 

(<i>  ■“semantics  <sem>  >  <sem3> 

■“semantics  <sem>  +  ))■ 

#  If  there’s  a  comgoal  with  a  surface  attribute  (probably  caused  by  emotion  code), 

#  give  it  a  high  preference,  otherwise,  it  might  lose  from  whatever  the  NLU  comes  up  with 
sp  ■Ctop-state*apply*operator*output-speech*comgoal-surf ace 

(state  <s>  ■“name  top-state 
■“operator  <o>) 

(<o>  '“name  output-speech 
'“goal  <cg>) 

(<cg>  ■“surface) 

— > 

(<o>  '“comgoal  <cg>  +  >)} 

#  If  there  are  two  speech  acts  and  one  of  them  is  incomplete  (NLU) ,  the 

#  other  one  (emotion  speech-act)  is  better 

sp  ■Ctop-state*apply*operator*output-speech*emotion-speech-act 


94 


APPENDIX  B.  SOAR  AND  TCL  CODE 


(state  <s>  '‘name  top-state 
'‘operator  <o>) 

(<o>  '‘name  understand-speech 

■“speech-input .  interpretation  <i>) 

(<i>  "“speech-act  <sal> 

■“speech-act  ■C<sa2>  <>  <sal>}) 

(<sa2>  '“content .  incomplete  yes) 

— > 

(<i>  "“speech-act  <sal>  +  > 

"“speech-act  <sal>  >  <sa2>)} 

#  If  there  are  two  surf ace-Ccuididates ,  the  one  with  the  highest  priority  is  preferred 
sp  {top-state*apply*operator*output-speech*surf ace-select ion*priority 

(state  <s>  "“name  top-state 
"“operator  <o>) 

(<o>  "“name  output-speech 
"“comgoal  <cg>) 

(<cg>  "“surface-candidate  <scl> 

■“surface-candidate  <sc2>) 

(<scl>  "“priority  <pl> 

"“output  <ol>) 

(<sc2>  "“priority  ■C<p2>  <  <pl>} 

"“output  <o2>) 

— > 

(<cg>  "“surface  <ol>  >  <o2> 

■“surface  <ol>  +  >  )} 

#  If  there ^s  one  surface-candidate,  make  it  the  surface 

sp  ■Ctop-state*apply*operator*output-speech*surf ace-select ion*copy 
(state  <s>  "“name  top-state 
"“operator  <o>) 

(<o>  "“name  output-speech 
"“comgoal  <cg>) 

(<cg>  "“surface-candidate  <scl> 

-"“surf ace-Ccuididate  {<sc2>  <>  <scl>}) 

(<scl>  '“output  <ol>) 

— > 

(<cg>  "“surface  <ol>  +  >  )} 

#  TCL  prodedure  which  produces  the  attribute  name  for  the  responsible  agent  question 
proc  stateResponsible  {emotion}  { 

set  uttercuice  responsible-f or- 
append  utterance  $emotion 
return  $utterance 

} 

#  Adds  attribute  ’"“time  future’  to  sem,  when  a  state  has  nog  happened  yet.  Necessary 

#  to  get  the  right  tense  in  the  answer  when  asking  ’why’  as  a  follow  up  question  to  for 

#  instance  ‘‘I’m  hopeful’’. 

sp  {top-state*apply*operator*output-speech*answer-state*why-question*assert*speech-acts* 
emotion-future 
(state  <s>  "“name  top-state 
"“operator  <o> 

"“agent-name  <me>) 

(<o>  "“name  output-speech 
"“goal  <obl> 

"“comgoal  <cg>) 

(<obl>  "“action  address 
"“content  <csa>) 

(<csa>  "“action  info-req 
"“content  <sem>) 
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(<sein>  "“type  question 
'■prop  <seinl> 

'■q-slot  cause 
■'reference  <ref>) 

(<ref>  '‘attribute  <<  max-feeling  feeling  » 
■'cause  <cause> 

■'source .  appraisal  .feature .  status  unconfirmed) 
(<seml>  ““type  state) 

(<cg>  ■'sem  <semcg>) 

— > 

(write  (crlf)  TEST  (crlf)) 

(<semcg>  ■'time  future  +  >  )} 


B.3  Lexicon-emia.soar 


###  Copyright  2003  Arno  Hartholt  iTijmen  Joppe  Muller 
###  Institute  for  Creative  Technologies 

################################################################################ 

### 

###  File  :  lexicon-emia.soar 


###  Original  author(s): 
### 

###  Supervisor  : 
###  Organization  : 
###  Created  on  : 
###  Last  Modified  By  : 
###  Soar  Version  : 
###  Documentation  : 


Arno  Hartholt  (hartholtOict . use . edu) 
Tijmen  Joppe  Muller  (tijmen@avpecl910.nl) 
Jonathan  Cratch  (gratchOict . use . edu) 
Institute  for  Creative  Technologies 
November  13,  2003 
Arno  Hartholt 
7 

Interaction  on  emotions 


### 

### _ 

###  HISTORY 
### 

###  11-17-03  [AH] 
###  11-26-03  [AH] 
###  12-04-03  [AH] 
###  12-29-03  [AH] 
###  01-02-04  [AH] 
### 

### _ 

###  USE 
### 


(http :  //mullert .  adsl .  utwente .  nl/  ■'stage/report  s/emia .  pdf ) 


Document  created,  only  emotions 

Added  <states>  and  <emotion-responsibility-states> 
Added  <misc> 

Added  new  states  cuid  some  misc  words 
Added  synonym  ^scared’ 


###  Serves  as  an  add-on  for  lexicon. soar. 


###  <states>  sums  up  all  states  and  the  words  used  to  point  to  a  certain  state. 

###  <emotions>  is  used  to  get  to  the  internal  representation  of  an  emotion  from 
###  natural  language 

###  <emotion-responsibility-states>  is  not  really  used  for  mapping  of  natural  language 
###  to  internal  representation,  but  for  detecting 

###  the  right  goal  in  output-speech 

###  <misc>  is  a  list  of  words  which  could  be  included  in  one  of  the  original  lexicon 
###  entries 

### _ 

###  ISSUES 
### 

###  As  both  the  words  ^mark’  cuid  ’secure'  point  to  the  secure  attribute  in  the 
###  original  lexicon,  this  can  lead  to  a  misunderstanding  of  the  user,  as  the 
###  distinction  between  Iz-marked  and  Iz-secure  cannot  always  be  made. 

### _ 

###  KNOWN  BUGS 
### 
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### _ 

###  LIMITATIONS 
### 

### _ 

###  EXTERNAL  REFERENCES 
### 

###  Used  in  combination  with  emotion-states-emia. soar  and  language-emia. soar 

### _ 

###  TO  DO 
### 

### _ 

###  SUMMARY 
### 

### 

################################################################################ 
echo  "\nLoading  lexicon-emia. soar\n" 

#  Adds  words  concerning  emotions  to  the  allready  existing  lexicon 
sp  ■Ctop-state*elaborate*state*add-lexicon-entries*emotions 
(state  <s>  ■“name  top-state 

■“agent-name  <<  sgt  medic  director  >> 

■“lexicon  <lexicon>) 

— > 

(<lexicon>  ■“states  <states> 

■“emotions  <emotions> 

■“emotion-responsibility-states  <emotion-responsibility-states> 

■“misc  <misc>) 

(<states>  '“maintain-goodwill  crowd  +  &,  goodwill  +  & 

■“crowd-cuigry  crowd  +  &,  |  Anger  I  +  & 

■“boy-dead  boy  +  &,  dead  +  & 

■“boy-healthy  boy  +  &,  healthy  +  & 

■“minor-injuries  minor-injuries  +  &,  injuries  +  &,  boy  +  & 

■“serious-injuries  serious-injuries  +  Sc,  injuries  +  Sc,  boy  +  Sc 
■“critical-injuries  critical-injuries  +  Sc,  injuries  +  Sc,  boy  +  Sc 
■“driver-healthy  driver  +  Sc,  healthy  +  & 

■“driver-minor-inj  driver  +  Sc,  minor-injuries  +  Sc,  injuries  +  Sc 
■“mother-healthy  mom  +  Sc,  healthy  +  & 

■“know-boy-health  boy  +  Sc,  healthy  +  Sc,  known  +  Sc 
■“sqds-in-transit  squads  +  Sc,  transit  +  Sc 
■“It-in-transit  It  +  Sc,  transit  +  Sc 
“It-at-aa  It  +  &,  aa  +  & 

■“It-at-celic  It  +  &,  celic  +  Sc 
■“sgt-at-aa  sgt  +  &,  aa  +  & 

■“medic-at-aa  medic  +  Sc,  aa  +  & 

■“at-boy-aa  boy  +  &,  aa  +  & 

■“Ist-sqd-at-aa  Ist-sqd  +  &,  aa  +  & 

■“Ist-sqd-at-celic  Ist-sqd  +  Sc,  celic  +  Sc 
■“Ist-sqd-at-lz  Ist-sqd  +  &,  Iz  +  & 

■“Ist-sqd-in-transit  Ist-sqd  +  Sc,  trcuisit  +  Sc 
■“2nd-sqd-at-aa  2nd-sqd  +  Sc,  aa.  +  Sc 
■“2nd-sqd-at-celic  2nd-sqd  +  Sc,  celic  +  Sc 
■“3rd-sqd-at-aa  3rd-sqd  +  &,  aa  +  & 

■“3rd-sqd-at-celic  3rd-sqd  +  Sc,  celic  +  Sc 
~3rd-sqd-at-lz  3rd-sqd  +  &,  Iz  +  & 

''4th-sqd-at-aa  4th-sqd  +  &,  aa  +  & 

■“4th-sqd-at-celic  4th-sqd  +  Sc,  celic  +  Sc 
~4th-sqd-at-lz  4th-sqd  +  &,  Iz  +  & 

■“4th-sqd- in-transit  4th-sqd  +  Sc,  trcuisit  +  Sc 
■“at -boy-hospital  boy  +  Sc,  hospital  +  Sc 
■“mom-in-intersect  mom  +  Sc,  intersection  +  Sc 
■“sqd-in-intersect  sqd  +  Sc,  intersection  +  Sc 
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"medevac-at-aa  medevac  +  &,  aa  +  & 

"medevac-at-base  medevac  +  &,  base  +  & 

'‘medevac-called  medevac  +  &,  called  +  & 

"medevac-overhead  medevac  +  &,  overhead  +  & 

'‘amb-at-aa  amb  +  &,  aa  +  & 

“amb-at-base  amb  +  &,  base  +  & 

■“ambulance-called  amb  +  &,  called  +  & 

'“secure-route  route  +  &,  secured  +  Sc 
■“aa-secure  aa  +  &,  secured  +  & 

■“accident-secure  accident  +  &,  secured  +  & 

“12-to-4-secure  12-to-4  +  Sc,  secured  +  Sc 
'“4-to-8-secure  4-to-8  +  Sc,  secured  +  & 

■“8-to-12-secure  8-to-12  +  Sc,  secured  +  & 

■“Iz-secure  Iz  +  &,  secured  +  & 

'“Iz-marked  Iz  +  &,  marked  +  Sc 
'“Iz-clear  Iz  +  Sc,  clear  +  & 

■“support-1-6  eagle2-6  +  Sc,  support  +  & 

"retain-mass  eagle2-6  +  Sc,  together  +  Sc 
"fracture-unit  eagle2-6  +  Sc,  fractured  +  Sc 
■“1-6-at-celic  eaglel-6  +  Sc,  celic  +  & 

■“hospital-at-tuzla  hospital  +  Sc,  tuzla  +  Sc) 

(<emotions>  "“I  Anger  I  cuiger  +  Sc,  cuigry  +  Sc,  annoyed  +  Sc,  irritated  +  Sc,  pissed  +  Sc,  mad  +  Sc 
■“I  Anxiety  I  cuixiety  +  Sc,  anxious  +  & 

■“[Distress  I  distress  +  Sc,  distressed  +  Sc,  upset  +  Sc,  disturbed  +  &, 
troubled  +  Sc,  worried  +  Sc,  concerned  +  Sc,  sad  Sc  + 

■“[Fear I  fear  +  &,  fearful  +  Sc,  afraid  +  Sc,  frightened  +  Sc,  stressed  +  Sc, 
pessimistic  +  Sc,  scared  +  Sc 
“I  Guilt  I  guilt  +  Sc,  guilty  +  Sc 
■“I  Hope  I  hope  +  Sc,  hopeful  +  Sc,  optimistic  +  Sc 
■“I  Joy  I  joy  +  Sc,  joyful  +  Sc,  excited  +  &,  happy  +  &) 

(<emotion-responsibility-states>  ■“  I responsible-f or-Anger  I  cuiger  +  Sc,  cuigry  +  Sc,  annoyed  +  Sc, 

irritated  +  & 

■“  I  responsible-f  or-Anxiety  I  anxiety  +  Sc,  cuixious  +  Sc,  worried  +  Sc, 
concerned  +  Sc 

■“  I  responsible-f  or-Distress  I  distress  +  Sc,  distressed  +  Sc,  upset  +  Sc, 
disturbed  +  Sc,  troubled  +  Sc 

■“  I  responsible-f  or-Fear  I  fear  +  Sc,  fearfull  +  Sc,  afraid  +  Sc,  frightened  +  Sc, 
stressed  +  Sc,  pessimistic  +  Sc,  scared  +  Sc 
■“  I  responsible-f  or-Guilt  I  guilt  +  Sc,  guilty  +  Sc 
■“  I  responsible-f  or-Hope  I  hope  +  Sc,  hopefull  +  Sc,  optimistic  +  Sc 
■“  I  responsible-f  or-Joy  I  joy  +  Sc,  joyfull  +  Sc,  exited  +  Sc,  happy  +  Sc) 

(<misc>  "“crowd  crowd  +  Sc,  bosnians  +  Sc 
■“goodwill  goodwill  +  Sc 
■“known  known  +  Sc,  know  +  Sc 
■“intersection  intersection  +  Sc 
■“together  together  +  Sc 
■“sqd  squad  +  Sc,  sqd  +  Sc 

■“fractured  fracture  +  Sc,  fractured  +  Sc,  split  +  Sc,  splitting  +  Sc 

~eaglel-6  eaglel-6  +  Sc 

■“injuries  injuries  +  Sc,  injured  +  Sc 

■“call  called  +  &)} 
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Appendix  C 

Test  plans 


The  statements  between  <  and  >  refer  to  unknown  identifier  names,  they  are 
randomly  choosen  by  the  Soar  system.  It  is  tried  to  choose  them  in  a  way  it  is 
clear  what  complex  object’s  they  refer  to. 

C.l  Phase  1 

C.1.1  top-ps*emia*elaborate*lookup-table*template 

Conditions 

None. 

Test  plan 

1.  Add  rule  to  the  system. 

Expected  results 

1.  Creation  of  WME  (SI  "emia-template-f  illing  <emia-template-f  illing>)  . 

2.  Creation  of  WME  (<emia-template-filling>  "nl-emotion  <nl-emotion>) 
(equivalent  for  the  other  eight  ~nl-  attributes). 

Results 

All  expected  results  were  met. 

C.1.2  top-ps*emia*elaborate*emotion-state*max-f eeling 

Conditions 

1.  Initialized  agent  sergeant  is  used  as  testing  environment;  the  intensity  for 
hope  is  0.57,  the  intensity  for  distress  is  0.56  and  the  intensity  for  the 
other  emotions  are  about  0. 
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Test  plan 

1.  Add  rule  to  the  system. 

2.  Bring  intensity  of  emotion  hope  below  the  intensity  of  distress. 

3.  Bring  intensity  of  emotion  hope  equal  to  the  intensity  of  distress. 

Expected  results 

After  first  step  of  the  test  plan: 

1.  Creation  of  WME  (<current-state>  "<newl>  <newnamel>). 

2.  Creation  of  WME  (<current-state>  "<new2>  <newname2>). 

3.  Creation  of  WME  (<newnamel>  "attribute  max-feeling). 

4.  Creation  of  WME  (<newnamel>  "belief  true). 

5.  Creation  of  WME  (<newnamel>  "polarity  positive). 

6.  Creation  of  WME  (<newnamel>  "value  I  Hope  I). 

7.  Creation  of  trivial  WME’s  concerning  object  <newnamel>. 

8.  Creation  of  object  <newname2>,  the  inverse  of  <newncmiel>. 

After  second  step  of  the  test  plan: 

1.  Rejection  of  object  <newnamel>. 

2.  Rejection  of  object  <newname2>. 

3.  Creation  of  WME  (<current-state>  "<new3>  <newname3>). 

4.  Creation  of  WME  (<current-state>  "<new4>  <newname4>). 

5.  Creation  of  WME  (<newname3>  "attribute  max-feeling). 

6.  Creation  of  WME  (<newname3>  "belief  true). 

7.  Creation  of  WME  (<newname3>  "polarity  positive). 

8.  Creation  of  WME  (<newname3>  "value  I  Distress  I). 

9.  Creation  of  trivial  WME’s  concerning  object  <newname3>. 

10.  Creation  of  object  <newname4>,  the  inverse  of  <newnEmie3>. 

After  third  step  of  the  test  plan: 

1.  Rejection  of  object  <newname3>. 

2.  Rejection  of  object  <newname4>. 

3.  Creation  of  WME  (<current-state>  "<new5>  <newname5>). 

4.  Creation  of  WME  (<current-state>  "<new6>  <newname6>). 
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5.  Creation  of  WME  (<newname5>  “attribute  max-feeling). 

6.  Creation  of  WME  (<newname5>  “belief  true). 

7.  Creation  of  WME  (<newname5>  “polarity  positive). 

8.  Creation  of  WME  (<newname5>  “value  emotion  ),  where  emotion  is  a 
random  pick  between  I  Hope  I  and  I  Distress  I . 

9.  Creation  of  trivial  WME’s  concerning  object  <newname5>. 

10.  Creation  of  object  <newnajne6>,  the  inverse  of  <newname5>. 

Results 

All  expected  results  were  met. 

C.1.3  top-ps*emia*elaborate*emotion-state*f eeling*true 

Conditions 

1.  Initialized  agent  sergeant  is  used  as  testing  environment;  the  intensity  for 
hope  is  0.57,  the  intensity  for  distress  is  0.56  and  the  intensity  for  the 
other  emotions  are  about  0. 

Test  plan 

1.  Add  rule  to  the  system. 

2.  Bring  intensity  of  emotion  distress  to  about  0. 

3.  Bring  intensity  of  emotion  fear  to  about  0.5. 

Expected  results 

After  first  step  of  the  test  plan: 

1.  Creation  of  WME  (<current-state>  “<newl>  <newnamel>). 

2.  Creation  of  WME  (<current-state>  “<new2>  <newname2>). 

3.  Creation  of  WME  (<newnamel>  “attribute  feeling). 

4.  Creation  of  WME  (<newnamel>  “belief  true). 

5.  Creation  of  WME  (<newnamel>  “polarity  positive). 

6.  Creation  of  WME  (<newnamel>  “value  I  Distress  I). 

7.  Creation  of  trivial  WME’s  concerning  object  <newnamel>. 

8.  Creation  of  object  <newnajne2>,  the  inverse  of  <newnamel>. 

9.  Creation  of  object,  equal  to  <newnamel>,  but  with  “value  I  Hope  I . 

10.  No  creation  of  any  other  object  with  “attribute  feeling. 
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After  second  step  of  the  test  plan: 

1.  Rejection  of  object  <newnamel>. 

2.  Rejection  of  object  <newname2>. 

After  third  step  of  the  test  plan: 

1.  Creation  of  WME  (<current-state>  "<new3>  <newname3>). 

2.  Creation  of  WME  (<current-state>  "<new4>  <newname4>). 

3.  Creation  of  WME  (<newname3>  "attribute  feeling). 

4.  Creation  of  WME  (<newname3>  "belief  true). 

5.  Creation  of  WME  (<newname3>  "polarity  positive). 

6.  Creation  of  WME  (<newname3>  "value  I  Fear  I). 

7.  Creation  of  trivial  WME’s  concerning  object  <newname3>. 

8.  Creation  of  object  <newname4>,  the  inverse  of  <newnEmie3>. 

Since  the  design  for  all  seven  emotions  in  the  system  are  equal,  we  can  safely 
assume  that  if  the  above  tests  are  executed  correctly,  the  creation  of  emotion 
states  for  all  emotions  are  covered  by  this  rule. 

Results 

All  expected  results  were  met. 

C.1.4  top-ps*eniia*elaborate*emotion-state*f  eeling*f  alse 

Conditions 

1.  Initialized  agent  sergeant  is  used  as  testing  environment;  the  intensity  for 
hope  is  0.57,  the  intensity  for  distress  is  0.56  and  the  intensity  for  the 
other  emotions  are  about  0. 

Test  plan 

1.  Add  rule  to  the  system. 

2.  Bring  intensity  of  emotion  distress  to  about  0. 

3.  Bring  intensity  of  emotion  fear  to  about  0.5. 
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Expected  results 

After  first  step  of  the  test  plan: 

1.  Creation  of  WME  (<current-state>  ~<newl>  <newnamel>) . 

2.  Creation  of  WME  (<current-state>  ~<new2>  <newname2>) . 

3.  Creation  of  WME  (<newnamel>  “attribute  feeling). 

4.  Creation  of  WME  (<newnamel>  “belief  true). 

5.  Creation  of  WME  (<newnamel>  “polarity  negative). 

6.  Creation  of  WME  (<newnamel>  “value  iFearl). 

7.  Creation  of  trivial  WME’s  concerning  object  <newnamel>. 

8.  Creation  of  object  <newnajne2>,  the  inverse  of  <newnamel>. 

9.  Creation  of  objects,  equal  to  <newnamel>,  but  with  “value  I  Anger  I, 
“value  I  Anxiety  I,  “value  I  Guilt  I,  “value  I  Joy  I . 

10.  No  creation  of  any  other  object  with  “attribute  feeling. 

After  second  step  of  the  test  plan: 

1.  Creation  of  WME  (<current-state>  “<new3>  <newname3>) . 

2.  Creation  of  WME  (<current-state>  “<new4>  <newname4>) . 

3.  Creation  of  WME  (<newname3>  “attribute  feeling). 

4.  Creation  of  WME  (<newname3>  “belief  true). 

5.  Creation  of  WME  (<newname3>  “polarity  negative). 

6.  Creation  of  WME  (<newname3>  “value  I  Distress  I). 

7.  Creation  of  trivial  WME’s  concerning  object  <newname3>. 

8.  Creation  of  object  <newnajne4>,  the  inverse  of  <newname3>. 

After  third  step  of  the  test  plan: 

1.  Rejection  of  object  <newnamel>. 

2.  Rejection  of  object  <newname2>. 

Since  the  design  for  all  seven  emotions  in  the  system  are  equal,  we  can  safely 
assume  that  if  the  above  tests  are  executed  correctly,  the  creation  of  emotion 
states  for  all  emotions  are  covered  by  this  rule. 

Results 

All  expected  results  were  met. 


104 


APPENDIX  C.  TEST  PLANS 


C.1.5  top-state*apply*operator*understand-speech*nlu* 
how-do-you-f eel 

Conditions 

none 

Test  plan 

1.  Add  rule  to  the  system. 

2.  Ask  “How  do  you  feel?”. 

3.  Ask  “How  do  you  feel  about  the  boy?”. 

Expected  results 

After  first  step  of  test  plan:  rule  should  not  fire.  After  second  step  of  test  plan: 

1.  Creation  of  WME  (“interpretation  mood  question) 

2.  Creation  of  WME  (“interpretation  emotion-semantics  <emotion-semantics>) 

3.  Creation  of  WME  (<emotion-semantics>  “type  question) 

4.  Creation  of  WME  (<emotion-semantics>  “q-slot  value) 

5.  Creation  of  WME  (<emotion-semantics>  “prop  <sem>) 

6.  Creation  of  WME  (<sem>  “attribute  max-feeling) 

7.  Creation  of  WME  (<sem>  “type  state) 

After  third  step  of  test  plan:  rule  should  not  fire 

Since  the  design  of  this  rule  is  identical  to  that  of  .  .  .  *nlu*whats-wrong-with-you, 

. . . *nlu*do-you-f eel-emotion,  . . . *nlu*calm-down  and  . . .*nlu*relax,  we 
can  safely  assume  that  if  the  above  tests  are  executed  correctly,  all  four  rules 
are  covered. 

Results 

All  expected  results  were  met. 

C.1.6  top-state*elaborate*state*add-lexicon-entries*emotions 
Conditions 

none 

Test  plan 


1.  Add  rule  to  the  system. 
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Expected  results 

After  first  step  of  test  plan: 

1.  Creation  of  WME  (“lexicon  states  <states>) 

2.  Creation  of  WME  (“lexicon  emotions  <emotions>) 

3.  Creation  of  WME  (“lexicon  emotion-responsibility-states  <emotion-responsibility-states>) 

4.  Creation  of  WME  (“lexicon  misc  <misc>) 

5.  Creation  of  WME  (<states>  “maintain-goodwill  crowd)  (equivalent 
for  other  50  states) 

6.  Creation  of  WME  (<emotions>  “I  Anger  I  anger) 

7.  Creation  of  WME  (<emotions>  “I  Anger  I  angry) 

8.  Creation  of  WME  (<emotions>  “I  Anger  I  annoyed) 

9.  Creation  of  WME  (<emotions>  “I  Anger  I  irritated)  (equivalent  for 
other  6  emotions) 

10.  Creation  of  WME  (<emotion-responsibility-states>  “  I  responsible-f  or-Anger  I  anger) 

11.  Creation  of  WME  (<emotion-responsibility-states>  “  I  responsible-f  or-Anger  I  angry) 

12.  Creation  of  WME  (<emotion-responsibility-states>  “  I  responsible-f  or-Anger  I  annoyed) 

13.  Creation  of  WME  (<emotion-responsibility-states>  “  I  responsible-f  or-Anger  I  irritated) 
(equivalent  for  other  6  emotions) 

14.  Creation  of  WME  (<misc>  “crowd  crowd)  (equivalent  for  other  3  mis- 
celanious  words) 

Results 

All  results  were  met. 

C.2  Phase  2 

C.2.1  top-ps*emia*elaborate*lookup-table*static-content*template 

Conditions 

1.  Rule  top-ps*emia*elaborate*lookup-table*template. 

Test  plan 


1.  Add  rule  to  the  system. 
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Expected  results 

1.  Creation  of  WME  (<nl-emotion>  ~  I  Anger  I  I  angry  I  (equivalent  for  the 
other  six  emotion  translations) . 

2.  Creation  of  WME  (<nl-intensity-lower>  ~0  I  "a  little"  I  (equiva¬ 
lent  for  the  other  four  lower  intensity  bound  translations). 

3.  Creation  of  WME  (<nl-intensity-upper>  "0.25  I  "a  little"  I  (equiv¬ 
alent  for  the  other  four  upper  intensity  bound  translations). 

4.  Creation  of  WME  (<nl-polarity>  "negative  I  noth 

5.  Creation  of  WME  (<nl-responsible_agent>  "Isldr  iJohnsonI  (equiv¬ 
alent  for  the  other  seven  responsible  agent  pronoun  translations). 

6.  Creation  of  WME  (<nl-responsible_agent-poss>  "Isldr  I  "Johnson’ s"  I 
(equivalent  for  the  seven  responsible  agent  possesive  pronoun  transla¬ 
tions). 

7.  Creation  of  WME  (<nl-state-pre>  "boy-dead  I  "the  boy"  I  (equiva¬ 
lent  for  the  other  50  state  translations). 

8.  Creation  of  WME  (<nl-state-post>  "boy-dead  I  dead  I  (equivalent  for 
the  other  50  state  translations). 

9.  Creation  of  WME  (<nl-status>  "confirmed  I  being  I  (equivalent  for 
the  other  status  translation). 

Results 

For  this  rule,  only  indirect  testing  was  possible  as  the  Soar  GUI  isn’t  able  to  deal 

with  quotes  correctly,  which  results  in  an  inability  to  show  the  corresponding 

WME’s.  Testing  showed  the  WME’s  were  present  internally  though,  so  we  can 

state  that  all  expected  results  were  met. 

C.2.2  top-ps*eniia*elaborate*lookup-table*dyncLmic-content* 
medic 

Conditions 

1.  Agent  sergeant  is  used  as  testing  environment. 

2.  Rule  top-ps*emia*elaborate*lookup-table*template. 

Test  plan 

1.  Add  rule  to  the  system. 

Expected  results 

1.  Creation  of  WME  (<nl-responsible_agent>  "medic  iTuccil. 

2.  Creation  of  WME  (<nl-responsible_agent-poss>  "medic  iTucci’sl. 
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Results 

Both  expected  results  were  met. 

C.2.3  top-ps*emia*elaborate*lookup-table*dynainic-content*mom 

Conditions 

1.  Agent  sergeant  is  used  as  testing  environment. 

2.  Rule  top-ps*emia*elaborate*lookup-table*template. 

Test  plan 

1.  Add  rule  to  the  system. 

Expected  results 

1.  Creation  of  WME  (<nl-responsible_agent>  "mom  I  The  mother  I . 

2.  Creation  of  WME  (<nl-responsible_agent-poss>  "mom  I  the  mother’sl. 

Results 

Both  expected  results  were  met. 

C.2.4  top-ps*emia*elaborate*lookup-table*dynainic-content*sgt 

Conditions 

1.  Agent  sergeant  is  used  as  testing  environment. 

2.  Rule  top-ps*emia*elaborate*lookup-table*template. 

Test  plan 

1.  Add  rule  to  the  system. 

Expected  results 

1.  No  creation  of  WME’s. 

Results 

The  expected  result  was  met. 

C.2.5  top-ps*emia*elaborate*lookup-table*dynainic-content*self 

Conditions 

1.  Agent  sergeant  is  used  as  testing  environment. 

2.  Rule  top-ps*emia*elaborate*lookup-table*template. 
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Test  plan 

1.  Add  rule  to  the  system. 

Expected  results 

1.  Creation  of  WME  (<nl-responsible_agent>  ~sgt  1 1  am|. 

2.  Creation  of  WME  (<nl-responsible_agent-poss>  ~sgt  |my|. 

Results 

Both  expected  results  were  met. 

C.2.6  top-ps*eniia*emotion-state*add*causality 

Conditions 

1.  Initialized  agent  sergeant  is  used  as  testing  environment;  the  intensity  for 
hope  is  0.57,  the  intensity  for  distress  is  0.56  and  the  intensity  for  the  other 
emotions  are  about  0.  The  appraisal  with  highest  intensity  concerning  the 
emotion  hope  appraises  the  state  aa-secure. 

2.  Rule  top-ps*emia*elaborate*emotion-state*max-f eeling 
Test  plan 

1.  Add  rule  to  the  system. 

Expected  results 

1.  Creation  of  WME  (<max-feeling-emotion-state>  “cause  aa-secure). 

2.  Creation  of  WME  (<max-feeling-emotion-state>  “source  <appraisal-object>)  . 

Since  the  construction  for  the  feeling  emotion  state  is  equal  to  that  of  the 
max-feeling  emotion  states,  we  can  safely  assume  that  if  the  above  tests  are 
executed  correctly,  the  causality  is  also  added  correctly  to  the  feeling  emotion 
states. 

Results 

All  expected  results  were  met. 

C.2.7  top-state*apply*operator*understand-speech*nlu* 
how-do-you-f eel-about-state*one 

Conditions 

Rule  top-state*elaborate*state*add-lexicon-entries*emotions 
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Test  plan 

1.  Add  rule  to  the  system. 

2.  Ask  “How  do  you  feel  about  the  crowd?” 

3.  Ask  “How  do  you  feel  about  the  boy?” 

4.  Ask  a  few  samples  at  random. 

Expected  results 

After  first  step  of  test  plan:  rule  should  not  fire.  After  second  step  of  test  plan: 

1.  Creation  of  WME  (~ interpretation  mood  question) 

2.  Creation  of  WME  ("interpretation  emotion-semantics  <emotion-semantics>) 

3.  Creation  of  WME  (<emotion-semantics>  "type  question) 

4.  Creation  of  WME  (<emotion-semantics>  "q-slot  value) 

5.  Creation  of  WME  (<emotion-semantics>  "priority  1) 

6.  Creation  of  WME  (<emotion-semEtntics>  "prop  <sem>) 

7.  Creation  of  WME  (<sem>  "attribute  f  eeling-about-state) 

8.  Creation  of  WME  (<sem>  "type  state) 

9.  Creation  of  WME  (<sem>  "cause  maintain-goodwill) 

After  third  step  of  test  plan:  idem  as  step  two,  but  mapping  to  all  states 
concerning  the  boy,  choosing  one  of  them  for  the  cause: 

1.  boy-dead 

2.  boy-healthy 

3.  minor-injuries 

4.  serious-injuries 

5.  critical-injuries 

6.  know-boy-health 

7.  at-boy-aa 

8.  at -boy-hospital 

After  fourth  step  of  test  plan:  idem  as  step  two,  but  mapping  cause  to  the 
appropiate  state. 

The  fourth  step  of  the  test  plan  is  a  compromise  between  testing  all  states 
and  being  time  efficient.  Together  with  the  testing  of  similar  rules  for  two  and 
three  keywords  for  states,  and  the  lexicon  testing,  this  should  provide  enough 
security  about  the  correctness  of  the  code. 
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Results 

The  third  part  of  the  test  plan  went  not  according  to  plan,  as  the  states 
minor-injuries,  serious-injuries  and  critical-injuries  were  pointed  to 
twice  and  the  state  driver-minor-inj  also  mapped  to  “boy”.  This  is  due  to 
how  te  original  lexicon  was  set  up,  namely  diveded  into  various  domains.  As 
several  domains  must  be  used  by  the  emotion  code  in  order  to  find  the  nec¬ 
essary  synonyms,  the  code  scans  all  the  domains  in  the  lexicon.  By  adding  a 
specific  states  domain,  this  too  is  included  in  the  search  and  so  “boy”  can 
lead  to  “minor-injuries”  and  from  there  to  either  to  the  state  minor-injuries 
or  driver-minor-inj.  To  avoid  these  situations  the  Soar  code  for  this  rule 
(and  the  similar  rules  for  two  and  three  keywords)  has  been  changed,  so  it  will 
exclude  the  states  domain.  Also,  the  emotion-responsibility-states  entry 
is  excluded  as  this  led  to  conflicts  when  using  emotions  for  state  detection. 

Furthermore,  there  were  some  minor  issues  with  both  the  existing  as  the 
emotion  lexicon,  like  spelling  errors  and  missing  synonyms.  These  were  fixed. 

C.2.8  top-state*apply*operator*understand-speech*nlu* 
how-do-you-f eel-about-state*two 

Conditions 

Rule  top-state*elaborate*state*add-lexicon-entries*emotions 
Test  plan 

1.  Add  rule  to  the  system. 

2.  Ask  “How  do  you  feel  about  the  boy  being  injured?”. 

3.  Ask  “How  do  you  feel  about  the  driver  being  healthy?”. 

4.  Ask  “How  do  you  feel  about  the  route  being  secured?” . 

5.  Ask  a  few  samples  at  random. 

Expected  results 

After  first  step  of  test  plan:  rule  should  not  fire.  After  second  step  of  test  plan: 

1.  Creation  of  WME  (“interpretation  mood  question) 

2.  Creation  of  WME  (“interpretation  emotion-semantics  <emotion-semEuitics>) 

3.  Creation  of  WME  (<emotion-semantics>  “type  question) 

4.  Creation  of  WME  (<emotion-semantics>  “q-slot  value) 

5.  Creation  of  WME  (<emotion-semantics>  “priority  2) 

6.  Creation  of  WME  (<emotion-semantics>  “prop  <sem>) 

7.  Creation  of  WME  (<sem>  “attribute  f  eeling-about-state) 

8.  Creation  of  WME  (<sem>  “type  state) 
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9.  Creation  of  WME  (<sem>  “cause  [min/ser/crit] -injuries) 

After  third  step  of  test  plan:  idem  as  step  two,  but  mapping  cause  to  state 
dr iver-healthys . 

After  fourth  step  of  test  plan:  idem  as  step  two,  but  mapping  cause  to  state 
route-secure. 

After  fith  step  of  test  plan:  idem  as  step  two,  but  mapping  cause  to  the 
appropiate  state. 

As  the  principal  for  all  other  states  is  equivalent  and  the  lexicon  rule  has 
already  been  tested,  we  can  savely  assume  that  if  the  above  tests  are  executed 
correctly,  this  holds  true  for  all  states. 

Results 

There  were  some  minor  issues  with  both  the  existing  as  the  emotion  lexicon, 
like  spelling  errors  and  missing  synonyms.  These  were  fixed. 

C.2.9  top-state*apply*operator*understand-speech*nlu* 
how-do-you-f eel-about-state*three 

Conditions 

Rule  top-state*elaborate*state*add-lexicon-entries*emotions 
Test  plan 

1.  Add  rule  to  the  system. 

2.  Ask  “How  do  you  feel  about  the  boy  having  serious  injuries?”. 

3.  Ask  “How  do  you  feel  about  the  minor  injuries  of  the  boy?”. 

4.  Ask  “How  do  you  feel  about  the  driver  having  minor  injuries?” . 

5.  Ask  a  few  samples  at  random. 

Expected  results 

After  first  step  of  test  plan:  rule  should  not  fire.  After  second  step  of  test  plan: 

1.  Creation  of  WME  (“interpretation  mood  question) 

2.  Creation  of  WME  (“interpretation  emotion-semantics  <emotion-semantics>) 

3.  Creation  of  WME  (<emotion-semEtntics>  “type  question) 

4.  Creation  of  WME  (<emotion-semEtntics>  “q-slot  value) 

5.  Creation  of  WME  (<emotion-semEtntics>  “priority  3) 

6.  Creation  of  WME  (<emotion-semcUitics>  “prop  <sem>) 

7.  Creation  of  WME  (<sem>  “attribute  f  eeling-about-state) 

8.  Creation  of  WME  (<sem>  “type  state) 
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9.  Creation  of  WME  (<sem>  "cause  serious-injuries) 

After  third  step  of  test  plan:  idem  as  step  two,  but  mapping  cause  to  state 
minor-in juries. 

After  fourth  step  of  test  plan:  idem  as  step  two,  but  mapping  cause  to  state 
driver-minor-inj . 

After  fifth  step  of  test  plan:  idem  as  step  two,  but  mapping  cause  to  the 
appropiate  state. 

As  the  principal  for  all  other  states  is  equivalent  and  the  lexicon  rule  has 
already  been  tested,  we  can  savely  assume  that  if  the  above  tests  are  executed 
correctly,  this  holds  true  for  all  states. 

Results 

There  were  some  minor  issues  with  both  the  existing  as  the  emotion  lexicon, 
like  spelling  errors  and  missing  synonyms.  These  were  fixed. 

C.2.10  top-state*apply*operator*understand-speech*nlu* 
do-you-f eel-emotion 

Conditions 

Rule  top-state*elaborate*state*add-lexicon-entries*emotions 
Test  plan 

1.  Add  rule  to  the  system. 

2.  Ask  “Why  do  you  feel  guilty?” 

3.  Ask  “Who’s  responsible  for  making  you  feel  angry?” 

4.  Ask  “Are  you  angry?”. 

5.  Ask  “Do  you  feel  anger?”. 

6.  Ask  “You  seem  worried”. 

7.  Ask  “You  look  guilty” . 

8.  Ask  a  few  samples  at  random. 

Expected  results 

After  the  first,  second  and  third  step  of  test  plan:  rule  should  not  fire.  After 
fourth  step  of  test  plan: 

1.  Creation  of  WME  ("interpretation  mood  question) 

2.  Creation  of  WME  ("interpretation  emotion-semantics  <emotion-semEtntics>) 

3.  Creation  of  WME  (<emotion-semantics>  "type  question) 

4.  Creation  of  WME  (<emotion-semantics>  "q-slot  polarity) 
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5. 

6. 

7. 

8. 


Creation  of  WME 
Creation  of  WME 
Creation  of  WME 
Creation  of  WME 


(<emotion-semEtritics>  “prop  <sem>) 
(<sem>  “attribute  feeling) 

(<sem>  “type  state) 

(<sem>  “value  I  Anger  I ) 


After  fifth  step  of  test  plan:  idem  as  step  four 

After  sixth  step  of  test  plan:  idem  as  step  four,  but  mapping  value  to  state 
I  Distress  I . 

After  seventh  step  of  test  plan:  idem  as  step  four,  but  mapping  value  to 
state  I  Guilt  I . 

After  eighth  step  of  test  plan:  idem  as  step  four,  but  mapping  value  to  the 
appropiate  emotion. 

As  the  principal  for  all  emotions  is  equivalent  and  the  lexicon  rule  has  already 
been  tested,  we  can  savely  assume  that  if  the  above  tests  are  executed  correctly, 
this  holds  true  for  all  emotions. 


Results 

As  Soar  is  case  sensive,  the  question  “Why  do  you  feel  guilty”  did  trigger  this 
rule,  because  it  didn’t  contain  the  word  “why”,  but  “Why”.  It  will  be  stated 
that  alle  sentences  should  be  typed  in  lower  case  characters.  All  other  results 
were  met. 


C.2.11  top-state*apply*operator*understand-speech*nlu* 
why-do-you-f eel-emotion 

Conditions 

Rule  top-state*elaborate*state*add-lexicon-entries*emotions 
Test  plan 

1.  Add  rule  to  the  system. 

2.  Ask  “Why  do  you  feel  guilty?” 

3.  Ask  “Why  are  you  worried?” 

4.  Ask  a  few  samples  at  random. 

Expected  results 

After  the  first  step  of  test  plan:  rule  should  not  fire.  After  second  step  of  test 
plan: 

1.  Creation  of  WME  (“interpretation  mood  question) 

2.  Creation  of  WME  (“interpretation  emotion-semantics  <emotion-semantics>) 

3.  Creation  of  WME  (<emotion-semantics>  “type  question) 

4.  Creation  of  WME  (<emotion-semELntics>  “q-slot  cause) 
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5.  Creation  of  WME  (<emotion-semantics>  “prop  <sem>) 

6.  Creation  of  WME  (<sem>  “attribute  feeling) 

7.  Creation  of  WME  (<sem>  “type  state) 

8.  Creation  of  WME  (<sem>  “value  I  Guilt  I) 

After  third  step  of  test  plan:  idem  as  step  four,  but  mapping  value  to  state 
I  Distress  I . 

Results 

The  question  “Why  do  you  feel  guilty?”  let  to  the  firing  of  both  .  .  .  *nlu* 
why-do-you-f eel-emotion  and  . . . *nlu*responsible-for-emotion*guil, be¬ 
cause  of  overlapping  keywords.  It  showed  that  the  latter  scanned  for  certain 
keywords  which  were’nt  necessary.  This  was  fixed.  All  other  results  were  met. 

C.2.12  top-state*apply*operator*understand-speech*nlu* 
responsible-f or-emotion 
proc  stateResponsible 

As  the  rule  top-state*apply*operator*understand-speech*nlu*responsible-f or-emotion 
is  used  together  with  proc  stateResponsible,  we  test  them  in  one  test. 

Conditions 

Rule  top-state*elaborate*state*add-lexicon-entries*emotions 
Test  plan 

1.  Add  rule  to  the  system. 

2.  Ask  “Whos  responsible  for  making  you  feel  hopeful?” 

3.  Ask  a  few  samples  at  random. 

Expected  results 

After  the  first  step  of  test  plan:  rule  should  not  fire.  After  second  step  of  test 
plan: 

1.  Creation  of  WME  (“interpretation  mood  question) 

2.  Creation  of  WME  (“interpretation  emotion-semantics  <emotion-semEuitics>) 

3.  Creation  of  WME  (<emotion-semantics>  “type  question) 

4.  Creation  of  WME  (<emotion-semantics>  “q-slot  value) 

5.  Creation  of  WME  (<emotion-semantics>  “prop  <sem>) 

6.  Creation  of  WME  (<sem>  “attribute  responsible-f  or-Hope) 

7.  Creation  of  WME  (<sem>  “type  state) 
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After  third  step  of  test  plan:  idem  as  step  four,  but  mapping  attribute  to 
state  I  Distress  I. 

As  the  design  is  similar  for  the  rule  .  .  .nlu*responsible-for-emotion*guilt, 
we  can  savely  assume  that  if  the  above  tests  are  executed  correctly  and  if  during 
the  fourth  step  these  rules  are  coverd,  this  holds  true  for  both  rules. 

Results 

All  expected  results  were  met. 

C.3  Phase  3 

C.3.1  top-ps*emia*emotion-state*add*causality*to*negation 

Conditions 

1.  Initialized  agent  sergeant  is  used  as  testing  environment;  the  intensity  for 
hope  is  0.57,  the  intensity  for  distress  is  0.56  and  the  intensity  for  the  other 
emotions  are  about  0.  The  appraisal  with  highest  intensity  concerning  the 
emotion  hope  appraises  the  state  at -boy-hospital. 

2.  Rule  top-ps*emia*elaborate*emotion-state*max-f eeling 

3.  Rule  top-ps*emia*emotion-state*add*causality 

Test  plan 

1.  Add  rule  to  the  system. 

Expected  results 

1.  Creation  of  WME  (<max-feeling-emotion-state-negated>  “cause  at -boy-hospital)  . 

2.  Creation  of  WME  (<max-feeling-emotion-state-negated>  “source  <appraisal-object>) . 

Since  the  construction  for  the  feeling  emotion  state  is  equal  to  that  of  the 
max-feeling  emotion  states,  we  can  safely  assume  that  if  the  above  tests  are 
executed  correctly,  the  causality  is  also  added  correctly  to  the  feeling  emotion 
states. 

Results 

All  expected  results  were  met. 

C.3. 2  top-ps*emia*elaborate*emotion-state*responsible-f or- [emotion] 

Conditions 

1.  Initialized  agent  sergeant  is  used  as  testing  environment;  the  intensity  for 
hope  is  0.57,  the  intensity  for  distress  is  0.56  and  the  intensity  for  the  other 
emotions  are  about  0.  The  appraisal  with  highest  intensity  concerning 
the  emotion  hope  appraises  the  state  at-boy-hospital.  The  responsible 
agent  for  this  state  is  the  medevac. 
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2.  Rule  top-ps*emia*elaborate*emotion-state*f eeling 

3.  Rule  top-ps*emia*emotion-state*add*causality 

Test  plan 

1.  Add  rule  to  the  system. 

Expected  results 

1.  Creation  of  WME  (<current-state>  "<newl>  <newnamel>). 

2.  Creation  of  WME  (<current-state>  "<new2>  <newname2>). 

3.  Creation  of  WME  (<newnamel>  “attribute  responsible-f  or-Anger)  . 

4.  Creation  of  WME  (<newnamel>  “belief  true). 

5.  Creation  of  WME  (<newnamel>  “cause  praiseworthy). 

6.  Creation  of  WME  (<newnamel>  “polarity  positive). 

7.  Creation  of  WME  (<newnamel>  “value  medevac). 

8.  Creation  of  trivial  WME’s  concerning  object  <newnamel>. 

9.  Creation  of  object  <newname2>,  the  inverse  of  <newnEmiel>. 

10.  Creation  of  objects,  equal  to  <newnamel>  and  their  inverses,  but  with 

“attribute  responsible-f or-Anxiety,  “attribute  responsible-f or-Distress, 
“attribute  responsible-f or-Fear,  “attribute  responsible-f or-Hope, 
“attribute  responsible-f or-Guilt,  “attribute  responsible-f or-Joy, 
only  if  a  causality  exists. 

Results 

All  expected  results  were  met. 

C.3.3  top-state*apply*operator*understand-speech* 
emotion-semantics-priority 

Conditions 

1.  Rule  top-state*apply*operator*understand-speech*nlu* 

how-do-you-f  eel-about-state*two  or  top-state*apply*operator*understand- 
speech*nlu*how-do-you-feel-about-state*three 

Test  plan 

1.  Add  rule  to  the  system. 

2.  Ask  “How  do  you  feel  about  the  boy?”. 

3.  Ask  “How  do  you  feel  about  the  boy  being  injured?”. 

4.  Ask  “How  do  you  feel  about  the  driver  having  minor  injuries?” 
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Expected  results 

After  the  first  and  second  step  of  the  test  plan,  the  rule  should  not  fire. 

After  the  third  step  of  the  test  plan,  there  are  only  emotion-semantics 
attributes  with  priority  2. 

Afther  the  fourth  step  of  the  test  plan,  there  are  only  emotion-semantics 
attributes  with  priority  3. 

Results 

All  expected  results  were  met. 

C.3.4  top-state*apply*operator*understand-speech* 
emot ion-semantics- select ion*same 

Conditions 

1.  Rule  top-state*apply*operator*understand-speech*nlu*how-do-you-f eel-about-state*two 
or  top-state*apply*operator*understand-speech*nlu*how-do-you-feel-about- 
state*three 

Test  plan 

1.  Add  rule  to  the  system. 

2.  Ask  “How  do  you  feel  about  the  boy?”. 

3.  Ask  “How  do  you  feel  about  the  boy  being  injured?”. 

4.  Ask  “How  do  you  feel  about  the  driver  having  minor  injuries?” 

Expected  results 

After  the  first  step  of  the  test  plan,  the  rule  should  not  fire. 

After  the  second  step  of  the  test  plan,  there’s  eventually  only  one  emotion-semantics 
with  has  priority  1. 

After  the  third  step  of  the  test  plan,  there’s  eventually  only  one  emotion-semantics 
with  has  priority  2. 

After  the  fourth  step  of  the  test  plan,  there’s  eventually  only  one  emotion-semantics 
with  has  priority  3. 

Results 

All  expected  results  were  met. 

C.3.5  top-state*apply*operator*understand-speech* 

emot ion-semantics- select ion*cause-vs-rebel-without-a-cause 

Conditions 

1.  Rule  top-state*apply*operator*understand-speech*nlu*how-do-you-f eel-about-state*two 
or  top-state*apply*operator*understand-speech*nlu*how-do-you-feel-about- 
state*three 
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Test  plan 

1.  Add  rule  to  the  system. 

2.  Ask  “How  do  you  feel  about  the  boy?”. 

3.  Ask  “How  do  you  feel  about  the  boy  being  injured?”. 

4.  Ask  “How  do  you  feel  about  the  driver  having  minor  injuries?” 

Expected  results 

After  the  first  step  of  the  test  plan,  the  rule  should  not  fire. 

The  other  steps  should  result  in  all  emotion-states  which  have  cause;  all 
other  states  should  be  discarded. 

Results 

All  expected  results  were  met. 

C.3.6  top-state*apply*operator*understand-speech* 

emotion-semantics-selection*intensity-vs-no-intensity 

Conditions 

1.  Rule  top-state*apply*operator*understand-speech*nlu* 

how-do-you-f  eel-about-state*two  or  top-state*apply*operator*understand- 
speech*nlu*how-do-you-feel-about-state*three 

Test  plan 

1.  Add  rule  to  the  system. 

2.  Ask  “How  do  you  feel  about  the  boy?”. 

3.  Ask  “How  do  you  feel  about  the  boy  being  injured?”. 

4.  Ask  “How  do  you  feel  about  the  driver  having  minor  injuries?” 

Expected  results 

After  the  first  step  of  the  test  plan,  the  rule  should  not  fire. 

The  other  steps  should  result  in  all  emotion-states  which  have  an  intensity; 
all  other  states  should  be  discarded. 

Results 

All  expected  results  were  met. 
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C.3.7  top-state*apply*operator*understand-speech* 
emotion-semantics-pref erence*sem 

Conditions 

1.  Rule  top-state*apply*operator*understand-speech*nlu* 

how-do-you-f  eel-about-state*two  or  top-state*apply*operator*understand- 
speech*nlu*how-do-you-feel-about-state*three 

Test  plan 

1.  Add  rule  to  the  system. 

2.  Ask  “How  do  you  feel  about  the  boy?”. 

3.  Ask  “How  do  you  feel  about  the  boy  being  injured?”. 

4.  Ask  “How  do  you  feel  about  the  driver  having  minor  injuries?” 

Expected  results 

After  the  first  step  of  the  test  plan,  the  rule  should  not  fire. 

The  other  steps  should  result  in  one  semantics  under  interpretation,  with 
the  same  attributes  and  values  as  emotion-semantics 

This  rule  is  simular  to  .  .  .  *emotion-semantics-pref  erence*semEtntics, 
so  if  these  test  are  executed  correctly,  we  can  savely  assume  both  rules  arre 
correct . 

Results 

All  expected  results  were  met. 

C.4  Phase  4 

This  section  will  exclusively  test  the  code  which  is  responsible  for  selecting 
and  outputting  the  agents’  utterances.  As  an  utterance  is  being  produced  by 
the  combination  of  both  a  Soar  rule  and  a  TCL  template,  these  will  be  tested 
together. 

The  first  two  tests  will  test  all  mechanisms  of  the  template.  As  all  the 
templates  are  constructed  according  to  the  same  design,  subsequent  template 
features  will  only  be  tested  randomly  for  the  sake  of  time. 

All  the  rules  are  dependend  on  the  rules  below.  Additional  depencies  will 
be  depicted  in  the  according  subsection. 

The  Initiative  value  of  the  agent  is  set  to  zero. 

1.  Rule  top-state*apply*operator*understand-speech*nlu*how-do-you-f eel 

or  top-state*apply*operator*understand-speech*nlu*whats-wrong-with-you 

2.  Rule  t op-st ate*apply*operat or *understand-speech*emot ion-semantics-priority 

3.  Rule  t op-st ate*apply*operat or *understand-speech*emot ion-semantics-select ion 

4.  Rule  top-state*apply*operator*understand-speech*emotion-semantics-pref erence*sem 
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5.  Rule  top-state*apply*operator*understand-speech* 
emotion-semantics-pref erence*semantics 

6.  Rule  top-state*apply*operator*understand-speech* 
emot i on- s emant i c s - int erpr et at i on- s emant i c s 

7.  Rule  top-ps*emia*elaborate*lookup-table*static-content*template 

8.  Rule  top-ps*emia*elaborate*lookup-table*dynainic-content*medic 

9.  Rule  top-ps*emia*elaborate*lookup-table*dynainic-content*mom 

10.  Rule  top-ps*emia*elaborate*lookup-table*dynainic-content*sgt 

11.  Rule  top-ps*emia*elaborate*lookup-table*dynainic-content*self 

C.4.1  top-state*apply*operator*output-speech* 
answer-how-do-you-f eel*cause 
proc  emotionTypeFeelCause 

Conditions 

1.  Rule  top-state*apply*operator*understand-speech*nlu*how-do-you-f eel 

2.  Rule  top-ps*emia*elaborate*emotion-state*max-f eeling 

3.  Rule  top-ps*emia*emotion-state*add*source 

4.  Rule  top-ps*emia*emotion-state*add*cause 

Test  plan 

1.  Add  rules  to  the  system. 

2.  Ask  “How  do  you  feel?”. 

3.  Set  Hope  <0.2,  ask  “How  do  you  feel?” 

4.  Set  Distress  >  0.75,  ask  “How  do  you  feel?” 

5.  Set  Distress  >  0.25  <  0.5,  ask  “How  do  you  feel?” 

6.  Set  Distress  >  0.2  <  0.25,  ask  “How  do  you  feel?” 

7.  Set  Terseness >  0.2,  ask  “How  do  you  feel?” 

8.  Set  Terseness  >  0.6,  ask  “How  do  you  feel?” 

9.  Set  Distress  <  0.2,  ask  “How  do  you  feel?” 
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Expected  results 

After  the  first  step  of  the  test  plan,  the  rule  should  not  fire. 

After  the  second  step  of  the  plan,  the  agent  should  utter  “I’m  hopeful  because 
the  boy  will  probably  be  treated  at  the  hospital” . 

After  the  third  step  of  the  plan,  the  agent  should  utter  “I’m  distressed 
because  the  boy  is  critically  injured” . 

After  the  fourth  step  of  the  plan,  the  agent  should  utter  “I’m  very  distressed 
because  the  boy  is  critically  injured” . 

After  the  fifth  step  of  the  plan,  the  agent  should  utter  “I’m  pretty  distressed 
because  the  boy  is  critically  injured” . 

After  the  sixth  step  of  the  plan,  the  agent  should  utter  “I’m  a  bit  distressed 
because  the  boy  is  critically  injured” . 

After  the  seventh  step  of  the  plan,  the  agent  should  utter  “I’m  a  bit  dis¬ 
tressed”  . 

After  the  eigth  step  of  the  plan,  the  agent  should  utter  “I’m  distressed” . 

After  the  ninth  step  of  the  plan,  the  agent  should  utter  “I’m  fine  sir”. 

Results 

All  expected  results  were  met,  although  sometimes  the  agent  answers  twice, 
either  directly  after  each  other,  or  seperated  by  the  phrase  “Well” .  This  will  be 
reported  as  a  bug. 

C.4.2  top-state*apply*operator*output-speech* 
answer-how-do-you-f eel*no-cause 
proc  emotionTypeFeelNoCause 

Conditions 

1.  Hope  set  to  0 

2.  Distress  set  to  0 

3.  Guilt  set  >  0  <  0.2 

4.  Rule  top-state*apply*operator*understand-speech*nlu*how-do-you-f eel 

5.  Rule  top-ps*emia*elaborate*emotion-state*max-f eeling 

Test  plan 

1.  Add  rules  to  the  system. 

2.  Ask  “How  do  you  feel?”. 

3.  Set  Guilt  >  0.2  <  0.25,  ask  “How  do  you  feel?” 

4.  Set  Guilt  >  0.25  <  0.5,  ask  “How  do  you  feel?” 

5.  Set  Guilt  >  0.5  <  0.75,  ask  “How  do  you  feel?” 

6.  Set  Guilt  >  0.75,  ask  “How  do  you  feel?” 

7.  Set  Terseness  >0.6,  ask  “How  do  you  feel?” 
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Expected  results 

After  the  first  step  of  the  test  plan,  the  rule  should  not  fire. 

After  the  second  step  of  the  plan,  the  agent  should  utter  “I’m  fine  sir” . 

After  the  third  step  of  the  plan,  the  agent  should  utter  “I’m  a  little  guilty” . 

After  the  fourth  step  of  the  plan,  the  agent  should  utter  “I’m  pretty  guilty” . 

After  the  fifth  step  of  the  plan,  the  agent  should  utter  “I’m  guilty” . 

After  the  sixth  step  of  the  plan,  the  agent  should  utter  “I’m  very  guilty” . 

After  the  seventh  step  of  the  plan,  the  agent  should  utter  “I’m  guilty”. 

Results 

All  expected  results  were  met.  It  is  noted  that  the  template  doesnt  produce 
good  natural  language  for  “guilt”.  This  is  something  to  be  looked  at. 

C.4.3  apply*output-speech*answer-do-you-f eel-emotion*cause 
proc  emotionTypeEmotionCause 

Conditions 

1.  Rule  top-state*apply*operator*understand-speech*nlu*how-do-you-f eel 

2.  Rule  top-ps*emia*elaborate*emotion-state*f eeling*true 

3.  Rule  top-ps*emia*elaborate*emotion-state*f eeling*f alse 

4.  Rule  top-ps*emia*emotion-state*add*source 

5.  Rule  top-ps*emia*emotion-state*add*cause 

Test  plan 

1.  Add  rules  to  the  system. 

2.  Ask  “Do  you  feel  hopeful?”. 

3.  Ask  “Are  you  distressed?”. 

4.  Set  Terseness  set  to>  0.25,  ask  “Do  you  feel  concerned?” 

5.  Set  Distress  set  to  >  0.1  <  0.2,  ask  “Are  you  distressed?” 

6.  Ask  similar  question  with  emotion  and  terseness  values  changed  randomly 

Expected  results 

After  the  first  step  of  the  test  plan,  the  rule  should  not  fire. 

After  the  second  step  of  the  plan,  the  agent  should  utter  “I  do  sir  because 
the  boy  will  probably  be  treated  at  the  hospital” . 

After  the  third  step  of  the  plan,  the  agent  should  utter  “I  do  sir  because  the 
boy  is  critically  injured” . 

After  the  fourth  step  of  the  plan,  the  agent  should  utter  “I  sure  do  sir” . 

After  the  fifth  step  of  the  plan,  the  agent  should  utter  “No  sir”. 

After  the  sixth  step  of  the  plan,  the  agent  should  utter  according  to  the 
question 
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Results 

All  expected  results  were  met.  It  is  noted  that  the  template  doesnt  differentiate 
between  the  verbs  “are”  and  “feel”.  This  is  something  to  be  looked  at. 

C.4.4  apply*output-speech*answer-do-you-f eel-emotion*no-cause 
proc  emotionTypeEmotionNoCause 

Conditions 

1.  Rule  top-state*apply*operator*understand-speech*nlu*how-do-you-f eel 

2.  Rule  top-ps*emia*elaborate*emotion-state*f eeling*true 

3.  Rule  top-ps*emia*elaborate*emotion-state*f eeling*f alse 

Test  plan 

1.  Add  rules  to  the  system. 

2.  Ask  “Are  you  happy?” 

3.  Set  Anxiety  >  0.1  <  0.2,  ask  “Do  you  feel  anxious?” 

4.  Ask  similar  question  with  emotion  and  terseness  values  changed  randomly 

Expected  results 

After  the  first  step  of  the  test  plan,  the  rule  should  not  fire. 

After  the  second  step  of  the  plan,  the  agent  should  utter  “Not  at  all  sir” . 

After  the  third  step  of  the  plan,  the  agent  should  utter  “No  sir” . 

After  the  fourth  step  of  the  plan,  the  agent  should  utter  according  to  the 
question 

Results 

All  expected  results  were  met. 

C.4.5  top-state*apply*operator*output-speech* 
answer-emotion-about-state*cause 
proc  emotionTypeState 

Conditions 

1.  Rule  top-state*apply*operator*understand-speech*nlu* 

how-do-you-f  eel-about-state*one  or  top-state*apply*operator*understand-speech*nlu* 
how-do-you-f  eel-about-state*two  or  top-state*apply*operator*understand-speech*nlu* 
how-do-you-f eel-about-state*three 

2.  Rule  top-ps*emia*elaborate*emotion-state*f eeling-about-state 
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Test  plan 

1.  Add  rules  to  the  system. 

2.  Ask  “How  do  you  feel  about  the  boy  being  critical  injured?” 

3.  Set  Hope  to  >  0.75,  ask  “How  do  you  feel  about  the  boy  going  to  the 
hospital?” 

4.  Ask  similar  question  with  emotion  and  terseness  values  changed  randomly 

Expected  results 

After  the  first  step  of  the  test  plan,  the  rule  should  not  fire. 

After  the  second  step  of  the  plan,  the  agent  should  utter  “I’m  distressed 
about  it  sir”. 

After  the  third  step  of  the  plan,  the  agent  should  utter  “I’m  very  hopeful 
about  it  sir”. 

After  the  fourth  step  of  the  plan,  the  agent  should  utter  according  to  the 
question 

Results 

It  came  to  light  that  the  Terseness  attribute  isn’t  always  present.  This  prevents 
our  rules  from  being  fired.  It  will  reported  as  a  bug  to  the  MRE  team.  Next  to 
that,  the  expected  result  only  turned  up  now  and  then.  This  will  be  treated  as 
a  bug. 

C.4.6  top-state*apply*operator*output-speech* 
answer-emotion-about-state*no-cause 

Couditious 

1.  Rule  top-state*apply*operator*understand-speech*nlu* 

how-do-you-f  eel-about-state*one  or  top-state*apply*operator*understEtrid-speech*nlu^ 
how-do-you-f  eel-about-state*two  or  top-state*apply*operator*understEtrid-speech*nlu^ 
how-do-you-f eel-about-state*three 

2.  Rule  top-ps*emia*elaborate*emotion-state*f eeling-about-state 
Test  plau 

1.  Add  rules  to  the  system. 

2.  Ask  “How  do  you  feel  about  the  route  being  secured?” 

3.  Ask  “How  do  you  feel  about  the  crowd?” 

Expected  results 

After  the  first  step  of  the  test  plan,  the  rule  should  not  fire. 

After  the  second  and  third  step  of  the  plan,  the  agent  should  utter  “That’s 
not  an  issue  right  now  sir” . 
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Results 

All  the  expected  results  were  met. 

C.4.7  top-state*apply*operator*output-speech*answer-calin-down 
proc  emotionCalm 

Conditions 

1.  Rule  top-state*apply*operator*understand-speech*nlu*calm-down  or 
top-state*apply*operator*understand-speech*nlu*relax 

2.  Rule  top-ps*emia*elaborate*emotion-state*f eeling-about-state 
Test  plan 

1.  Add  rules  to  the  system. 

2.  Say  “Calm  down,  you  maniac!” 

3.  Set  Hope  and  Distress  to  <  0.2,  “You’d  better  relax...” 

4.  Set  Fear  to  >  0.2,  say  ’’Calm  down,  soldier,  get  a  hold  of  yourself!  Wasn’t 
I  always  there  for  you  in  times  of  need?  Haven’t  I  always  covered  your 
back?  Looking  after  you  in  even  the  most  dangerous  of  situations?  Pull 
yourself  together  and  give  those  mother****ers  hell!!” 

Expected  results 

After  the  first  step  of  the  test  plan,  the  rule  should  not  fire. 

After  the  second  step  of  the  plan,  the  agent  should  utter  “Will  do  sir” . 

After  the  third  step  of  the  plan,  the  agent  should  utter  “I  am  calm,  sir” . 

After  the  fourth  step  of  the  plan,  the  agent  should  utter  “You’re  right,  sir! 

We  can  make  it  togheter!  You’ve  always  stood  by  my  side,  and  I  respect  you 
for  that;  both  as  my  superior,  and...  as  my  friend,”,  after  which  the  lieutenant 
and  the  sergeant  embrace  each  other,  assemble  their  men,  and  full  of  spirit  face 
the  enemy  on  the  battlefield  where  they  will  ultimately  die  a  heroes  death. 

Results 

The  first  step  showed  that  the  Soar  rule  matches  twice,  which  is  not  necessary. 

The  predicate  belief  true  was  therefore  added,  as  was  already  the  case  in  the 
other  Soar  rules.  All  expected  results  showed,  though,  except  for  the  fourth 
one,  which  was  actually  a  little  joke. 

C.4.8  apply*output-speech*answer-why-do-you-f eel-emotion* cause 
proc  emotionWhyCause 

Conditions 

1.  Rule  t op-st ate*apply*operat or *understand-speech*nlu*why-do-you-f eel-emotion 

or  top-state*apply*operator*understand-speech*nlu*whats-causing-you-to-f eel-emotion 

2.  Rule  top-ps*emia*elaborate*emotion-state*f eeling*true 


126 


APPENDIX  C.  TEST  PLANS 


3.  Rule  top-ps*emia*emotion-state*add*source 

4.  Rule  top-ps*emia*emotion-state*add*cause 

Test  plan 

1.  Add  rules  to  the  system. 

2.  Ask  “Why  do  you  feel  hopeful?” 

3.  Set  Devensiveness  >  0.75,  Ask  “Why  do  you  feel  hopeful?” 

4.  Ask  appropiate  question,  changing  emotions  and  Terseness  randomly 

Expected  results 

After  the  first  step  of  the  test  plan,  the  rule  should  not  fire. 

After  the  second  step  of  the  plan,  the  agent  should  utter  “Because  the  boy 
will  probably  be  treated  at  the  hospital  sir” . 

After  the  third  step  of  the  plan,  the  agent  should  utter  “That’s  personal  sir” . 

After  the  fourth  step  of  the  plan,  the  agent  should  react  accordingly. 

Results 

All  expected  results  were  met.  As  it  is  hard  to  get  the  agent  in  an  state  where  he 
really  blames  someone,  the  associated  output  was  tested  using  slightly  altered 
versions  of  the  code;  all  expected  results  were  met. 

C.4.9  apply*output-speech*answer-why-do-you-f eel-emotion* 

no-responsible-agent 
proc  emotionWhyNoResponsibleAgent 

Conditions 

1.  Rule  top-state*apply*operator*understand-speech*nlu* 

why-do-you-f  eel-emotion  or  top-state*apply*operator*understand-speech*nlu* 
what s-causing-you-to-f eel-emotion 

2.  Rule  top-ps*emia*elaborate*emotion-state*f eeling*true 

3.  Rule  top-ps*emia*emotion-state*add*cause 

Test  plan 

1.  Add  rules  to  the  system. 

2.  Ask  “Why  are  you  distressed?” 

3.  SeEt  Devensiveness  >  0.75,  Ask  “Why  are  you  distressed?” 

4.  Set  Distress  <  0.2,  ask  “Why  do  you  feel  distressed?” 
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Expected  results 

After  the  first  step  of  the  test  plan,  the  rule  should  not  fire. 

After  the  second  step  of  the  plan,  the  agent  should  utter  “Because  the  boy 
is  critically  injured  sir”. 

After  the  third  step  of  the  plan,  the  agent  should  utter  “That’s  personal  sir”. 

After  the  fourth  step  of  the  plan,  the  agent  should  utter  “I’m  not  distressed 
sir” . 

Results 

All  expected  results  were  met. 

C.4.10  apply*output-speech*answer-why-do-you-f eel-emotion*no-cause 
proc  emotionWhyNoCause 

Conditions 

1.  Rule  top-state*apply*operator*understaiid-speech*nlu* 

why-do-you-f  eel-emotion  or  top-state*apply*operator*understcUid-speech*nlu* 
what s-causing-you-to-f eel-emotion 

2.  Rule  top-ps*emia*elaborate*emotion-state*f eeling*true 
Test  plan 

1.  Add  rules  to  the  system. 

2.  Ask  “Why  are  you  anxious?” 

3.  Set  Anxiety  >  0.1,  Ask  “Why  do  you  feel  anxious?” 

Expected  results 

After  the  first  step  of  the  test  plan,  the  rule  should  not  fire. 

After  the  second  step  of  the  plan,  the  agent  should  utter  “I’m  not  anxious 
sir” . 

After  the  third  step  of  the  plan,  the  agent  should  utter  “I  don’t  know  sir” . 

Results 

Expected  results  sometimes  showed  up,  but  there  was  a  lot  of  interference  with 
the  original  code  which  handles  the  why-question.  This  will  be  discussed  with 
the  MRE  team. 

C.4.11  apply*output-speech*answer-whos-responsible 
proc  emotionResponsibility 

Conditions 

1.  Rule  top-state*apply*operator*understand-speech*nlu*responsible-f or-emotion 

or  top-state*apply*operator*understand-speech*nlu*responsible-f or-emotion*guilt 

2.  Rule  top-ps*emia*elaborate*emotion-state*responsible-f or- [emotion] 
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Test  plan 

1.  Add  rules  to  the  system. 

2.  Ask  “Who’s  responsible  for  making  you  feel  hopeful?” 

3.  Set  Hope  <  0.1,  Ask  “Who’s  responsible  for  making  you  feel  hopeful?” 

Expected  results 

After  the  first  step  of  the  test  plan,  the  rule  should  not  fire. 

After  the  second  step  of  the  plan,  the  agent  should  utter  “The  medevac  sir” . 

After  the  third  step  of  the  plan,  the  agent  should  utter  “I’m  not  hopeful  sir” . 

Results 

Some  minor  issues  concerning  the  template  filling  showed  up;  these  were  fixed. 

As  it  is  hard  to  get  the  agent  in  an  state  where  he  really  blames  someone, 
the  associated  output  was  tested  using  slightly  altered  versions  of  the  code;  all 
expected  results  were  met. 

C.4.12  apply*output-speech*answer-whos-responsible* 
no-responsible-agent 
proc  emotionNoResponsibility 

Conditions 

1.  Rule  top-state*apply*operator*understand-speech*nlu* 

responsible-f  or-emotion  or  top-state*apply*operator*understand-speech*nlu* 
responsible-f or-emotion*guilt 

2.  Rule  top-ps*emia*elaborate*emotion-state*responsible-f or- [emotion] 

Test  plan 

1.  Add  rules  to  the  system. 

2.  Ask  “Who’s  responsible  for  making  you  feel  guilty?” 

3.  Set  Guilty  >  0.2,  ask  “Who’s  responsible  for  making  you  feel  guilty?” 

Expected  results 

After  the  first  step  of  the  test  plan,  the  rule  should  not  fire. 

After  the  second  step  of  the  plan,  the  agent  should  utter  “I’m  not  guilty  sir”. 

After  the  third  step  of  the  plan,  the  agent  should  utter  “I  don’t  know  sir” . 

Results 

Some  minor  issues  concerning  the  template  filling  showed  up;  these  were  fixed. 
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C.5  Missing  tests 

e  rules  top-ps*emia*elaborate*emotion-state*f eeling-about-state  and 
top-ps*emia*emotion-state*f eeling-about-state*add*sim-object  have  not 
been  unit  tested,  because  of  the  difficulty  to  create  an  environment  with  the 
proper  left  hand  side.  The  first  rule  needs  an  operator,  but  it  is  not  possible  in 
Soar  to  hand  select  the  operator  at  any  given  point  in  time.  The  second  rule 
has  the  first  as  a  requirement,  so  without  it,  it  cannot  be  tested. 
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